Papers with Syntactic Text Processing
Phonotactic Complexity and Its Trade-offs (2020.tacl-1)
Copied to clipboard
| Challenge: | Existing measures of linguistic complexity are relatively coarse-see, for example, Moran and Blasi (2014) and 2 below for reviews. |
| Approach: | They propose to measure bits per phoneme using the negative log-probability of a word in a language model and a collection of 1016 basic concept words across 106 languages. |
| Outcome: | The proposed measure allows a cross-linguistic comparison of phonotactic complexity across languages. |
Reducing Confusion in Active Learning for Part-Of-Speech Tagging (2021.tacl-1)
Copied to clipboard
| Challenge: | Existing algorithms for annotating parts of speech are not optimal for all languages. |
| Approach: | They propose to use a data selection algorithm to select useful training samples to minimize annotation cost. |
| Outcome: | The proposed strategy outperforms existing strategies on six typologically diverse languages. |
Leveraging syntactic parsing to improve event annotation matching (D19-59)
Copied to clipboard
| Challenge: | Evaluating annotator consistency is crucial when building datasets for mention detection. |
| Approach: | They propose to use different fuzzy-matching functions to resolve this ambiguity by extracting syntactic heads present in annotations and using the Dice coefficient to measure similarity between sets. |
| Outcome: | The proposed functions are tested against the judgment of a human evaluator and show that the best-performing function agrees with the human . |
Personalizing Grammatical Error Correction: Adaptation to Proficiency Level and L1 (D19-55)
Copied to clipboard
| Challenge: | Grammar error correction systems have become ubiquitous in a variety of software applications, but little is known about how to efficiently personalize them to the user’s characteristics, such as proficiency level and first language. |
| Approach: | They propose to adapt a general purpose neural GEC system to the proficiency level and the first language of a writer, using only a few thousand annotated sentences. |
| Outcome: | The proposed system improves on adapting to proficiency level and first language . the results are the broadest of its kind, covering five proficiency levels and twelve different languages. |
UnifiedGEC: Integrating Grammatical Error Correction Approaches for Multi-languages with a Unified Framework (2025.coling-demos)
Copied to clipboard
| Challenge: | Existing tools for GEC have been developed to support research on grammatical errors, but there is no comprehensive evaluation on these models. |
| Approach: | They propose an open-source framework for Grammatical Error Correction that integrates 5 widely-used GEC models and compares their performance on 7 datasets in different languages. |
| Outcome: | The proposed framework compares 5 widely-used models on 7 datasets in different languages. |
How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanese (2023.acl-srw)
Copied to clipboard
| Challenge: | Existing studies on scriptio continua languages lack comprehensiveness of tokenizers . authors use Byte-Pair-Encoding or Unigram instead of WordPiece for subword tokenizer . |
| Approach: | They investigate the effect of tokenizers on the downstream performance of pretrained language models in scriptio continua languages where no explicit spaces exist between words. |
| Outcome: | The proposed tokenizers perform better on a wide range of tasks compared with other tokenizer methods . the results show that each task has an optimal morphological analyzer . |
A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing (2020.tacl-1)
Copied to clipboard
| Challenge: | Chinese word segmentation and dependency parsing suffer from error propagation . a graph-based model can integrate both tasks, but it suffers from performance limitations . |
| Approach: | They propose a graph-based model to integrate Chinese word segmentation and dependency parsing . their model achieves better performance than previous joint models . |
| Outcome: | The proposed model achieves better performance than previous joint models and state-of-the-art results in both Chinese word segmentation and dependency parsing. |
A Fast Algorithm for Computing Prefix Probabilities (2023.acl-short)
Copied to clipboard
| Challenge: | Probabilistic context-free grammars are an important formalism in NLP . |
| Approach: | They propose to run a probabilistic context-free grammar in O(n3|N|3 + |N|4), where n is the input length and |N is the number of non-terminals in the grammar. |
| Outcome: | The proposed algorithm runs in O(n3|N|3 + |N|4), where n is the input length and |N | is the number of non-terminals in the grammar. |
BERT is Not an Interlingua and the Bias of Tokenization (D19-61)
Copied to clipboard
| Challenge: | Cananical Correlation Analysis (CCA) of the internal representations of a pre- trained, multilingual BERT model reveals that the model partitions representations for each language rather than using a common, shared, interlingual space. |
| Approach: | They propose to use a multilingual BERT model to partition representations for each language rather than using a common, shared, interlingual space. |
| Outcome: | The results show that the model partitions representations for each language rather than using a common, shared, interlingual space. |
Understanding Secret Leakage Risks in Code LLMs: A Tokenization Perspective (2026.findings-acl)
Copied to clipboard
| Challenge: | Code Large Language Models (CLLMs) are reshaping how software is built, maintained, and evolved. |
| Approach: | They propose to use BPE tokenization to inadvertently leak code secrets . they propose to mitigate the gibberish bias by using a newer tokenizer . |
| Outcome: | The proposed model is based on a novel method that can be used to detect and mitigate gibberish bias in CLLMs. |
Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement (2021.tacl-1)
Copied to clipboard
| Challenge: | RNGTr is a non-recursive Graph-to-Graph Transformer for iterative refinement of graphs . it can improve the accuracy of initial parsers on 13 languages . |
| Approach: | They propose a recursive non-autoregressive Graph-to-Graph Transformer architecture for iterative refinement of arbitrary graphs and apply it to syntactic dependency parsing. |
| Outcome: | The proposed architecture can improve state-of-the-art on 13 languages and the German CoNLL2009 corpus. |
At a Glance: The Impact of Gaze Aggregation Views on Syntactic Tagging (D19-64)
Copied to clipboard
| Challenge: | Recent work uses gaze data at the type level or at the token level and mostly from a single eye-tracking corpus. |
| Approach: | They propose to use gaze data to capture central tendency or variability of gaze data and to integrate binary phrase chunking and part-of-speech tagging. |
| Outcome: | The proposed approaches capture the central tendency or variability of gaze data better than proposed local views which retain individual participant information. |
ZAEBUC: An Annotated Arabic-English Bilingual Writer Corpus (2022.lrec-1)
Copied to clipboard
| Challenge: | ZAEBUC is an annotated Arabic-English bilingual writer corpus . it is a corpus of short essays written by first-year university students . |
| Approach: | They propose to use a standard Arabic-English bilingual writer corpus to match comparable texts written by the same writer on different occasions. |
| Outcome: | The ZAEBUC corpus is an annotated Arabic-English bilingual writer corpus by first-year university students at Zayed University in the United Arab Emirates. |
CLEME2.0: Towards Interpretable Evaluation by Disentangling Edits for Grammatical Error Correction (2025.acl-long)
Copied to clipboard
Jingheng Ye, Zishan Xu, Yinghui Li, Linlin Song, Qingyu Zhou, Hai-Tao Zheng, Ying Shen, Wenhao Jiang, Hong-Gee Kim, Ruitong Liu, Xin Su, Zifei Shan
| Challenge: | Existing studies have focused on the interpretability of Grammatical Error Correction (GEC) evaluation metrics, but the interpretabilty of these metrics has been neglected. |
| Approach: | They propose a reference-based metric that describes four aspects of GEC systems: hit-correction, wrong-corrections, under-correcties, and over-corrects. |
| Outcome: | The proposed metric reveals critical qualities and locates drawbacks of GEC systems. |
Peek2: Regex-free Byte-level Byte-Pair Encoding Pretokenizer for LLM Inference on Edge Devices (2026.acl-srw)
Copied to clipboard
| Challenge: | Pretokenization is a crucial, sequential pass in Byte-level BPE tokenizers . little work has been done to optimize it for edge-side inference . |
| Approach: | They propose a pretokenization algorithm with linear time complexity and trivial memory usage that is suited for edge scenarios. |
| Outcome: | The proposed pretokenization algorithm improves microbenchmarking throughput by 2.48 and delivers 1.14 improvement in overall throughput across the entire Byte-level BPE encoding process. |
Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing (2021.eacl-demos)
Copied to clipboard
| Challenge: | Trankit is a lightweight, pre-trained toolkit for multilingual natural language processing. |
| Approach: | They propose a transformer-based toolkit for multilingual natural language processing that trains pipelines over 100 languages and 90 pretrained pipelines for 56 languages. |
| Outcome: | The proposed tool outperforms existing pipelines over sentence segmentation, part-of-speech tagging, morphological feature tabbing, and dependency parsing while maintaining competitive performance over tokenization, multi-word token expansion, and lemmatization over 90 Universal Dependencies treebanks. |
SyntaxGym: An Online Platform for Targeted Evaluation of Language Models (2020.acl-demos)
Copied to clipboard
| Challenge: | SyntaxGym is an online platform and open-source framework for targeted syntactic evaluation of neural network language models. |
| Approach: | They propose to make targeted syntactic evaluations accessible to both experts in NLP and linguistics and reproducible across computing environments. |
| Outcome: | The proposed framework is reproducible across computing environments and standardized following the norms of psycholinguistic experimental design. |
Evaluating Universal Dependency Parser Recovery of Predicate Argument Structure via CompChain Analysis (2021.starsem-1)
Copied to clipboard
| Challenge: | Compchains are a categorization of the hierarchy of predicate dependency relations present within a UD parse. |
| Approach: | They introduce compchains, a categorization of the hierarchy of predicate dependency relations present within a UD parse. |
| Outcome: | The proposed model performs poorly on sentences with predicate-argument structure with more than one level of embedding. |
Two Local Models for Neural Constituent Parsing (C18-1)
Copied to clipboard
| Challenge: | Non-local features have been shown crucial for statistical parsing, but local models can give highly competitive accuracies thanks to the power of dense neural input representations. |
| Approach: | They propose to use local neural models for constituent parsing to capture dependencies between sub output structures and to exploit non-local features. |
| Outcome: | The proposed model achieves labeled bracketing F1 scores of 92.4% on PTB and 87.3% on CTB 5.1. |
ListOps: A Diagnostic Dataset for Latent Tree Learning (N18-4)
Copied to clipboard
| Challenge: | Existing work on latent tree learning models shows they do not learn plausible grammars . a dataset is created to study the parsing ability of such models in natural language . |
| Approach: | They propose a toy dataset to study the parsing ability of latent tree learning models . they propose 'listops' toy that has a single correct parse strategy that a system needs to learn . |
| Outcome: | The proposed model outperforms existing models on sentence understanding tasks . it can learn grammars that conform to plausible semantics and syntactic formalisms . |
Towards Automatic Grammatical Error Type Classification for Turkish (2023.eacl-srw)
Copied to clipboard
| Challenge: | Existing error types are not universal, resulting in many language specific variants. |
| Approach: | They propose to use a rule-based error type classification pipeline to classify edits into predefined error categories for Turkish . they propose to change existing error categories to suit the inflectional and derivational properties of the language . |
| Outcome: | The proposed system is evaluated on 106 annotated sentences and its performance is measured as 77.04% F0.5 score. |
An In-depth Analysis of the Effect of Lexical Normalization on the Dependency Parsing of Social Media (D19-55)
Copied to clipboard
| Challenge: | Existing natural language processing tools are focused on standard texts, but performance drops when used on a different domain. |
| Approach: | They analyze the effect of manual and automatic lexical normalization for dependency parsing . they conclude that automatic normalization scores close to manually annotated normalization . |
| Outcome: | The proposed approach improves performance on social media data for many tasks . it is unclear which replacements have the most impact and what weaknesses exist in the system . |
Morphology Matters: A Multilingual Language Modeling Analysis (2021.tacl-1)
Copied to clipboard
| Challenge: | Existing studies on inflectional morphology disagree on whether or not it makes languages harder to model. |
| Approach: | They propose to use a corpus of 145 Bible translations in 92 languages to investigate whether inflectional morphology makes languages harder to model. |
| Outcome: | The proposed model trains with linguistically motivated subword segmentation strategies and reduces the impact of morphology on language modeling. |
Parsing linearizations appreciate PoS tags - but some are fussy about errors (2022.aacl-short)
Copied to clipboard
| Challenge: | Recent work on the impact of PoS tags on graph- and transition-based parsers suggests that they are only useful when tagging accuracy is prohibitively high or in low-resource scenarios. |
| Approach: | They examine the impact of PoS tags on graph- and transition-based parsers and propose to use them in a new paradigm for sequence labeling. |
| Outcome: | The proposed model is best when tagging accuracy and resource availability are high. |
FastKASSIM: A Fast Tree Kernel-Based Syntactic Similarity Metric (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing syntactic similarity metrics are computationally expensive and inconsistent when faced with syntaktically dissimilar documents. |
| Approach: | They propose a metric which pairs and averages the most similar constituency parse trees between a pair of documents based on tree kernels. |
| Outcome: | The proposed metric is more robust to syntactic dissimilarities and runs up to 5.32 times faster than its predecessor over documents in the r/ChangeMyView corpus. |
Phylogenic Multi-Lingual Dependency Parsing (N19-1)
Copied to clipboard
| Challenge: | phylogenetic learning is beneficial for low resourced languages and well furnished languages families. |
| Approach: | They propose to use the phylogenetic tree to guide the learning of multi-lingual dependency parsers . they use a phylogy tree to train models that leverage languages structural similarities . |
| Outcome: | The proposed model outperforms independently learned models on zero-shot parsing of unseen languages. |
Cross-lingual Parsing with Polyglot Training and Multi-treebank Learning: A Faroese Case Study (D19-61)
Copied to clipboard
| Challenge: | Cross-lingual dependency parsing involves transferring syntactic knowledge from one language to another. |
| Approach: | They compare two approaches to cross-lingual dependency parsing using monolingual source models and a polyglot model which is trained on the combination of all source languages. |
| Outcome: | The proposed methods improve low-resource dependency parsers by transferring syntactic knowledge from one language to another. |
Cool English: a Grammatical Error Correction System Based on Large Learner Corpora (C18-2)
Copied to clipboard
| Challenge: | Existing systems that correct grammatical errors are lacking in second language learning due to limited vocabulary and inadequate command of grammar. |
| Approach: | They propose a grammatical error correction system that provides corrective feedback for essays using a sequence-to-sequence model. |
| Outcome: | The proposed system achieves competitive performance on a number of publicly available testsets. |
Dialect Text Normalization to Normative Standard Finnish (D19-55)
Copied to clipboard
| Challenge: | a new method for normalizing dialect transcripts is proposed for normative Finnish . dialectal Finnish is the common way of communication for people online in finnish . |
| Approach: | They propose a method for normalizing dialectal Finnish into the normative standard Finnish. |
| Outcome: | The proposed method lowers the initial word error rate of the corpus from 52.89 to 5.73 . it can be used as one processing step with many types of spoken language materials. |
Improving Word Sense Induction through Adversarial Forgetting of Morphosyntactic Information (2024.starsem-1)
Copied to clipboard
| Challenge: | Contextualized word representations from pre-trained language models encode more information than is necessary for the identification of word senses and some of this information affect performance negatively in unsupervised settings. |
| Approach: | They propose to use a framework to erase specific information from pre-trained word models and create feature-invariant representations that are invariant to these ‘nuisance features’. |
| Outcome: | The proposed framework erases information from the representations of pre-trained language models, thereby creating feature-invariant representations. |
Reference-less Measure of Faithfulness for Grammatical Error Correction (N18-2)
Copied to clipboard
| Challenge: | Existing reference-less measures (RLMs) for measuring grammaticality are expensive to collect and limited by the large number of valid outputs. |
| Approach: | They propose a semantic measure for Grammatical Error Correction that compares the semantic symbolic structure of the source and correction without relying on manually-curated references. |
| Outcome: | The proposed measure shows that it can be applied consistently to ungrammatical text, and that valid corrections obtain a high USim similarity score to the source, and invalid corrections get lower scores. |
Exploring Statistical and Neural Models for Noun Ellipsis Detection and Resolution in English (2020.aacl-srw)
Copied to clipboard
| Challenge: | Existing approaches to noun ellipsis resolution have been sparse, using syntactic feature constraints for marking licensors and selecting their antecedents. |
| Approach: | They propose to use supervised machine learning to improve the existing F1 score by 16.55% and resolution by 14.97% for noun ellipsis subtasks. |
| Outcome: | The proposed framework improves the existing F1 score by 16.55% and the resolution subtask by 14.97%. |
A Computational Model of Latvian Morphology (2024.lrec-main)
Copied to clipboard
| Challenge: | a computational model of Latvian morphology provides a formal structure for Latvian word form inflection . the model explicitly enumerates and handles the many exceptions to the general Latvian inflation principles . |
| Approach: | They propose a computational model of Latvian morphology that provides a formal structure for Latvian word form inflection. |
| Outcome: | The proposed model provides a good coverage for modern Latvian literary language and potential to extend to Latgalian language. |
Automatic Spelling Correction for Resource-Scarce Languages using Deep Learning (P18-3)
Copied to clipboard
| Challenge: | Indic languages are resource-scarce and do not have such parallel data due to low volume of queries. |
| Approach: | They propose a sequence-to-sequence deep learning model which trains end-to end for Indic languages, Hindi and Telugu. |
| Outcome: | The proposed model is competitive with existing spell checking and correction techniques for Indic languages. |
Morphological Reinflection with Multiple Arguments: An Extended Annotation schema and a Georgian Case Study (2022.acl-short)
Copied to clipboard
| Challenge: | morphological annotations are a common problem in some languages, but the flat structure of the current schema makes it impossible to treat them. |
| Approach: | They propose a general solution for polypersonal agreement in Georgian language . they extend the existing UniMorph annotation schema to address this problem . |
| Outcome: | The proposed framework covers all possible variants of argument marking, and is accurate and balanced. |
Community lexical access for an endangered polysynthetic language: An electronic dictionary for St. Lawrence Island Yupik (N19-4)
Copied to clipboard
| Challenge: | a new electronic dictionary for St. Lawrence Island Yupik is developed to facilitate language-learning on the island . the endangered language is spoken primarily on St. lisa's St.liss island, Alaska . |
| Approach: | They propose a morphologically-aware electronic dictionary for St. Lawrence Island Yupik . the dictionary is set in an uncluttered interface and uses HTML, Javascript, and CSS . |
| Outcome: | The proposed dictionary is set in an uncluttered interface and is available in English and in Yupik . it is based on the morphologically-aware version of the Badten et al. paper dictionary . |
Do Diacritics Matter? Evaluating the Impact of Arabic Diacritics on Tokenization and LLM Benchmarks (2026.findings-eacl)
Copied to clipboard
| Challenge: | Diacritics can significantly influence language processing tasks in Arabic . their presence can increase subword fragmentation during tokenization, reducing performance . |
| Approach: | They analyze the impact of diacritics on tokenization and benchmark task performance across major Large Language Models. |
| Outcome: | The proposed model is robust to diacritics, but full diacritization leads to token fragmentation and degraded performance. |
To compress or not to compress? A Finite-State approach to Nen verbal morphology (2020.acl-srw)
Copied to clipboard
| Challenge: | a transitive verb takes up to 1,740 unique features and is highly complex, with a morphological complexity of 80.3% . a finite-state approach has been used to build morphology and phonology resources for Nen, an underresourced language in Papua New Guinea. |
| Approach: | They propose to use Finite-State methods to build a verbal morphological parser for an under-resourced Papuan language, Nen. |
| Outcome: | The proposed model is half the size of the full decomposed model, while the 'Chunking' model is under half the scale of the decomposer, with an overall accuracy of 80.3%. |
On the Relationship between Sentence Analogy Identification and Sentence Structure Encoding in Large Language Models (2024.findings-eacl)
Copied to clipboard
Thilini Wijesiriwardene, Ruwan Wickramarachchi, Aishwarya Naresh Reganti, Vinija Jain, Aman Chadha, Amit Sheth, Amitava Das
| Challenge: | Analogies facilitate the transfer of meaning and knowledge from one domain to another. |
| Approach: | They propose to use large language models to encode syntactic and semantic structures of sentences to identify sentence analogies. |
| Outcome: | The LLMs which capture syntactic structures better, also have higher abilities in identifying sentence analogies. |
How much complexity does an RNN architecture need to learn syntax-sensitive dependencies? (2020.acl-srw)
Copied to clipboard
| Challenge: | Long-term memory (LSTM) networks are capable of encapsulating long-range dependencies . but simple recurrent networks (SRNs) have been less successful at capturing long-term dependencies and loci of grammatical errors in an unsupervised setting. |
| Approach: | They propose a new architecture that incorporates the decaying nature of neuronal activations and models the excitatory and inhibitory connections in a population of neurons. |
| Outcome: | The proposed architecture shows competitive performance relative to LSTMs on subject-verb agreement, sentence grammaticality, and language modeling tasks. |
Scene Graph Parsing as Dependency Parsing (N18-1)
Copied to clipboard
| Challenge: | Recent studies have focused on parsing structured knowledge graphs from textual descriptions. |
| Approach: | They propose an alternative but equivalent scene graph representation that connects to dependency parses. |
| Outcome: | The proposed model outperforms best approaches on image retrieval applications. |
Sluice Resolution without Hand-Crafted Features over Brittle Syntax Trees (N18-2)
Copied to clipboard
| Challenge: | sluice resolution in english is the problem of finding antecedents of wh-fronted ellipses . previous work relied on hand-crafted features over syntax trees that scale poorly to other languages and domains . |
| Approach: | They propose a model that uses partial parsing to find antecedents of wh-fronted ellipses in english . their model significantly outperforms previous work on available newswires . |
| Outcome: | The proposed model outperforms the only previous work on available newswires. |
Grammatical Error Correction in Low-Resource Scenarios (D19-55)
Copied to clipboard
| Challenge: | Existing systems for grammatical error correction in English have been limited . however, there is limited progress on error correction of other languages . |
| Approach: | They propose a dataset on grammatical error correction for Czech and an annotated learner corpus for Russian and Czech. |
| Outcome: | The proposed model can reach new state-of-the-art on Czech, German and Russian datasets. |
Minimally-Augmented Grammatical Error Correction (D19-55)
Copied to clipboard
| Challenge: | Existing approaches to automatic grammatical error correction require error-labelled training data to achieve their best performance. |
| Approach: | They propose an unsupervised method that generates noise from inverted spell-checkers by using a synthetic error generation method. |
| Outcome: | The proposed method outperforms the current state-of-the-art for German and Russian GEC tasks without using real error-labelled training data. |
Joint Universal Syntactic and Semantic Parsing (2021.tacl-1)
Copied to clipboard
| Challenge: | Several attempts have been made to jointly parse syntax and semantics, but this trade-off is not well understood. |
| Approach: | They propose multiple model architectures that exploit the rich syntactic and semantic annotations contained in the Universal Decompositional Semantics dataset to obtain state-of-the-art results. |
| Outcome: | The proposed model outperforms existing models in 8 languages and their results are consistent across languages. |
Transition-based Neural RST Parsing with Implicit Syntax Features (C18-1)
Copied to clipboard
| Challenge: | Syntax has been a useful source of information for statistical RST discourse parsing. |
| Approach: | They propose an implicit syntax feature extraction approach using hidden-layer vectors extracted from a neural syntax parser. |
| Outcome: | The proposed model with dynamic oracle is competitive with existing models. |
WLASL-LEX: a Dataset for Recognising Phonological Properties in American Sign Language (2022.acl-short)
Copied to clipboard
| Challenge: | Signed Language Processing (SLP) is a major form of NLP, but has been overlooked by the NLP community. |
| Approach: | They leverage existing resources to construct a large-scale dataset of American Sign Language signs annotated with six different phonological properties. |
| Outcome: | The proposed model outperforms existing approaches on signs unobserved during training. |
Dependency Parsing with Backtracking using Deep Reinforcement Learning (2022.tacl-1)
Copied to clipboard
| Challenge: | Greedy algorithms for NLP such as transition-based parsing are prone to error propagation. |
| Approach: | They propose to allow transition-based parsing to backtrack in cases where evidence contradicts the current solution. |
| Outcome: | The proposed behavior can be implemented on POS tagging and dependency parsing . it shows that backtracking is an effective means to fight error propagation . |
Contextualized Usage-Based Material Selection (L18-1)
Copied to clipboard
| Challenge: | Currently, authentic linguistic examples for a given keyword search are organized alphabetically according to context. |
| Approach: | They propose to use NLP-functionalities to organize usage-based examples from corpora . they group retrieved examples on syntactic grounds, then show semantic similarity within phrasal slots . |
| Outcome: | The proposed system would help language learners and other end users to benefit from a distributional linguistic analysis. |
Morphological Inflection with Phonological Features (2023.acl-short)
Copied to clipboard
| Challenge: | Recent advances in morphological tasks can be difficult to solve when little training data is available or when generalizing to previously unseen lemmas. |
| Approach: | They propose two methods to manipulate phonemic data to include phonological features instead of characters. |
| Outcome: | The proposed methods yield comparable results to baseline models, with minor improvements in some languages. |
I Speak for the Árboles: Developing a Dependency Treebank for Spanish L2 and Heritage Speakers (2025.acl-srw)
Copied to clipboard
| Challenge: | Existing dependency treebanks for learner writing are limited due to morphosyntactic features. |
| Approach: | They propose to use a dependency treebank for Spanish learner writing from the UC Davis COWSL2H corpus to incorporate lemmatization, POS tagging, and syntactic dependencies. |
| Outcome: | The proposed treebanks are openly accessible to motivate future development of learner-oriented language technologies. |
Influence Functions for Sequence Tagging Models (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Named Entity Recognition, Part-of-Speech tagging, and Semantic Role Labeling are standard tasks in NLP, but there has been little work on interpretability methods for sequence taging. |
| Approach: | They propose to extend influence functions to sequence tagging tasks by identifying noisy annotations in NER corpora. |
| Outcome: | The proposed methods are able to identify noisy annotations in NER corpora and are scalable. |
Inherent Biases in Reference-based Evaluation for Grammatical Error Correction (P18-1)
Copied to clipboard
| Challenge: | Existing evaluation systems obtain comparable or superior performance compared to humans by making few but targeted changes to the input. |
| Approach: | They propose to re-scale M 2 by the inter-annotator agreement and increase the number of references in any feasible range to overcome low coverage bias in GEC evaluation. |
| Outcome: | The proposed measure overcomes low coverage bias in GEC evaluation by re-scaling or increasing the number of references in any feasible range. |
AQE: Argument Quadruplet Extraction via a Quad-Tagging Augmented Generative Approach (2023.findings-acl)
Copied to clipboard
| Challenge: | Argument mining involves multiple subtasks, but each one is insufficient for understanding argumentative structure and reasoning process. |
| Approach: | They propose a quadruplet extraction task that extracts four argumentative components . they use a generative quadragging module to augment the training of the generative framework . |
| Outcome: | The proposed method can extract arguments from a large-scale dataset. |
A Dynamic Oracle for Linear-Time 2-Planar Dependency Parsing (N18-2)
Copied to clipboard
| Challenge: | Existing dynamic oracles for greedy parsers can handle non-projective syntax, but none are available for these types of training. |
| Approach: | They propose an efficient dynamic oracle for training the 2-Planar transition-based parser with over 99% coverage on non-projective syntactic corpora. |
| Outcome: | The proposed model outperforms the static training strategy in the vast majority of languages tested and scored better on most datasets than the arc-hybrid parser enhanced with the Swap transition. |
Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checking (2021.findings-acl)
Copied to clipboard
| Challenge: | Chinese Spell Checking (CSC) aims to detect and correct erroneous characters for usergenerated text in Chinese. |
| Approach: | They propose a Chinese spell checker that leverages multimodal Chinese characters' information to predict the correct output. |
| Outcome: | The proposed model outperforms strong baselines on the SIGHAN benchmarks by a large margin. |
Rethinking Self-Attention: Towards Interpretability in Neural Parsing (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work shows that attention mechanisms provide arguably explainable attention distributions that can help to interpret predictions. |
| Approach: | They propose a new self-attention layer where attention heads represent labels. |
| Outcome: | The proposed model obtains state-of-the-art results on the Penn Treebank and Chinese Treebank. |
Improving Coverage and Runtime Complexity for Exact Inference in Non-Projective Transition-Based Dependency Parsers (N18-2)
Copied to clipboard
| Challenge: | Non-projective dependency trees account for 12.59% of all training sentences in the annotated Universal Dependencies (UD) 2.1 data. |
| Approach: | They generalize Cohen et al.'s (2011) parser to a family of non-projective transition-based dependency parsers allowing polynomial-time exact inference. |
| Outcome: | The proposed system can be extended to include a variant that reduces time complexity to O(n6), improving over the known bounds in exact inference for non-projective transition-based parsing. |
Text Segmentation as a Supervised Learning Task (N18-2)
Copied to clipboard
| Challenge: | Existing datasets for text segmentation are small in size and do not represent the natural distribution of text in documents. |
| Approach: | They propose a large dataset for text segmentation that is automatically extracted and labeled from Wikipedia and develop a model based on this dataset. |
| Outcome: | The proposed model generalizes well to unseen natural text. |
A Universal Dependencies Treebank for Highland Puebla Nahuatl (2024.naacl-long)
Copied to clipboard
| Challenge: | Annotated linguistic corpora are essential component of natural language processing (NLP) Annotation frameworks are used for morphological and dependency-based syntactic phenomena in endangered, indigenous, and/or marginalized languages. |
| Approach: | They propose a Universal Dependencies (UD) treebank for Highland Puebla Nahuatl . they describe the process of data collection, annotation decisions and interesting syntactic constructions . |
| Outcome: | The proposed treebank is the second such UD treebank for a Mexican language . it is a significant addition to an existing treebank of another Nahuatl language based on the framework . |
Left-to-Right Dependency Parsing with Pointer Networks (N19-1)
Copied to clipboard
| Challenge: | a new algorithm that parses sentences from left to right is simpler than the top-down stack-pointer parser . a graph-based dependency parsing model has been ahead of the curve in terms of accuracy in the past two years . |
| Approach: | They propose a transition-based algorithm that parses sentences from left to right by building n attachments, with n being the length of the input sentence. |
| Outcome: | The proposed algorithm outperforms the top-down stack-pointer parser and is twice as fast as the original top-up stack-pointing parsers. |
Multi-Reference Benchmarks for Russian Grammatical Error Correction (2024.eacl-long)
Copied to clipboard
| Challenge: | Using the union of the references increases system scores by more than 10 points, but not across error types. |
| Approach: | They propose multi-reference benchmarks for the Grammatical Error Correction of Russian . they use two existing single-refer datasets for a total of 7,444 learner sentences . |
| Outcome: | The proposed benchmarks show that new raters tend to make more changes, especially at the lexical level, compared to the original rater. |
Viable Dependency Parsing as Sequence Labeling (N19-1)
Copied to clipboard
| Challenge: | Existing work on dependency parsing by sequence labeling suggested that it was impractical. |
| Approach: | They propose to use dependency trees as sequence labels to obtain fast and accurate parsers using a conventional BILSTM-based model. |
| Outcome: | The proposed models are conceptually simple, not needing traditional parsing algorithms or auxiliary structures, and provide a good speed-accuracy tradeoff, with results competitive with more complex approaches. |
Adjusting the Precision-Recall Trade-Off with Align-and-Predict Decoding for Grammatical Error Correction (2022.acl-short)
Copied to clipboard
| Challenge: | Modern writing assistance applications always contain a Grammatical Error Correction (GEC) model to correct errors in user-entered sentences. |
| Approach: | They propose a simple yet effective approach to Align-and-Predict Decoding for most popular sequence-to-sequence models to offer more flexibility for the precision-recall trade-off. |
| Outcome: | The proposed model can be used in both English and Chinese GEC models and achieve state-of-the-art results. |
Simpler but More Accurate Semantic Dependency Parsing (P18-2)
Copied to clipboard
| Challenge: | Syntactic dependency parsing is the most popular method for automatically extracting low-level relationships between words in a sentence. |
| Approach: | They extend a syntactic dependency parser to train on and generate graph-structured representations that capture between-word relationships that are more closely related to the meaning of a sentence. |
| Outcome: | The proposed system beats the current state-of-the-art system by 0.6% and linguistically richer representations push the margin even higher. |
From Phonology to Syntax: Unsupervised Linguistic Typology at Different Levels with Language Embeddings (N18-1)
Copied to clipboard
| Challenge: | linguistic typology is the classification of languages according to their linguistic properties. |
| Approach: | They learn distributed language representations which can be used to predict typological properties on a massively multilingual scale. |
| Outcome: | The proposed model can predict typological properties on a massively multilingual scale. |
GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding (2023.acl-long)
Copied to clipboard
| Challenge: | grammatical error correction is an important NLP task that is usually solved with autoregressive sequence-to-sequence models. |
| Approach: | They propose a non-autoregressive approach to grammatical error correction that decouples a permutation network and a decoder network that fills in specific tokens. |
| Outcome: | The proposed approach improves over previously known non-autoregressive methods and reaches the level of autoregressive approaches that do not use language-specific synthetic data generation methods. |
The Computational Complexity of Distinctive Feature Minimization in Phonology (N18-2)
Copied to clipboard
| Challenge: | a standard assumption in phonology is that finding a minimal feature specification is an automatic part of acquisition and generalization. |
| Approach: | They analyze the problem of determining whether a set of phonemes forms a natural class and find the minimal feature specification for the class. |
| Outcome: | The proposed model is based on a greedy algorithm that fails to find minimal features . the proposed model can be used to find features that are universal across languages . |
Robust Multilingual Part-of-Speech Tagging via Adversarial Training (N18-1)
Copied to clipboard
| Challenge: | Adversarial training (AT) is a powerful regularization method for neural networks, aiming to achieve robustness to input perturbations. |
| Approach: | They propose and analyze a neural POS tagging model that exploits adversarial training by training on unmodified and adversarials. |
| Outcome: | The proposed model improves overall tagging accuracy and prevents over-fitting in low resource languages and boosts tabbing accuracy for rare / unseen words. |
The ACoLi CoNLL Libraries: Beyond Tab-Separated Values (L18-1)
Copied to clipboard
| Challenge: | a new set of Java archives facilitates advanced manipulations of corpora annotated in TSV formats. |
| Approach: | They propose to use Java archives to facilitate advanced manipulations of corpora annotated in TSV formats. |
| Outcome: | The proposed libraries support all members of the CoNLL format family. |
Rethinking Evaluation Metrics for Grammatical Error Correction: Why Use a Different Evaluation Process than Human? (2025.acl-short)
Copied to clipboard
| Challenge: | Existing automatic evaluation metrics are based on procedures that diverge from human evaluation. |
| Approach: | They propose to aggregate automatic evaluation metrics to bridge this gap . they propose to use edit-based metrics, -gram based metrics and sentence-level metrics to find the best ranking system. |
| Outcome: | The proposed method outperforms existing metrics on the SEEDA benchmark and improves edit-based metrics, -gram based metrics and sentence-level metrics. |
(Un)solving Morphological Inflection: Lemma Overlap Artificially Inflates Models’ Performance (2022.acl-short)
Copied to clipboard
| Challenge: | Inflection tasks have gained a lot of traction in recent years, mostly via SIGMORPHON's shared-tasks. |
| Approach: | They propose to use split-by-lemma to challenge the generalization capacity of morphological inflection models by employing harder train-test splits. |
| Outcome: | The proposed method is based on a split-by-lemma method that challenges the generalization capacity of the models. |
Books of Hours. the First Liturgical Data Set for Text Segmentation. (2020.lrec-1)
Copied to clipboard
Amir Hazem, Beatrice Daille, Christopher Kermorvant, Dominique Stutzmann, Marie-Laurence Bonhomme, Martin Maarand, Mélodie Boillet
| Challenge: | Until now, the book of hours has been scarcely studied because of its manuscript nature, its length and its complex content. |
| Approach: | They propose to use Handwritten Text Recognition to generate a corpus of Latin transcriptions of 300 books of hours generated by OCR for handwritten and not printed texts. |
| Outcome: | The proposed structure and state-of-the-art methods are compared with existing methods and are based on the results of a systematic evaluation of two books of hours. |
Ungrammatical-syntax-based In-context Example Selection for Grammatical Error Correction (2024.naacl-long)
Copied to clipboard
| Challenge: | In-context learning (ICL) has shown impressive results on many tasks, but applying LLMs to grammatical error correction (GEC) is still a challenging task. |
| Approach: | They propose an ungrammatical-syntax-based in-context example selection strategy that measures similarity of sentences based on their syntactic structures and identify optimal ICL examples sharing the most similar ill-formed syntax to the test input. |
| Outcome: | The proposed strategy outperforms word-matching and semantics-based methods on a syntax-oriented task like GEC on benchmark English datasets. |
A systematic comparison of methods for low-resource dependency parsing on genuinely low-resource languages (D19-1)
Copied to clipboard
| Challenge: | Large annotated treebanks are available for only a tiny fraction of the world's languages, and there is a wealth of literature on strategies for parsing with few resources. |
| Approach: | They propose three strategies for improving low-resource parsers: data augmentation, cross-lingual training, and transliteration. |
| Outcome: | The proposed methods improve low-resource parsers by using data augmentation, cross-lingual training, and transliteration. |
MORPHOGEN: A Multilingual Benchmark for Evaluating Gender-Aware Morphological Generation (2026.acl-long)
Copied to clipboard
| Challenge: | In morphologically rich languages, gender influences verb conjugation, pronouns, and even first-person constructions with explicit and implicit mentions of gender. |
| Approach: | They propose a morphologically grounded large-scale benchmark dataset for evaluating gender-aware generation in three typologically diverse grammatically gendered languages: French, Arabic, and Hindi. |
| Outcome: | The proposed dataset compares 15 popular multilingual large language models on their ability to handle morphological gender and morphology agreement. |
On Finding the K-best Non-projective Dependency Trees (2021.acl-long)
Copied to clipboard
| Challenge: | Existing work on finding the one-best dependency tree has not extended this to finding the K-best tree. |
| Approach: | They propose to simplify the K-best spanning tree algorithm by decoding the K best dependency trees with a root constraint. |
| Outcome: | The proposed algorithm can be used to find the K-best dependency trees without root constraint. |
Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models (2022.findings-acl)
Copied to clipboard
| Challenge: | Sequence-to-sequence models fail to generalize in hierarchy-sensitive manner when performing syntactic transformations. |
| Approach: | They evaluate whether seq2seq models generalize hierarchically on two transformations . they use pre-trained models and their multilingual variants to test their generalization . |
| Outcome: | The proposed models generalize hierarchically on two transformations in English and German. |
Prefix Lexicalization of Synchronous CFGs using Synchronous TAG (P18-1)
Copied to clipboard
| Challenge: | epsilon-free, chain-free synchronous context-free grammars can be converted into weakly equivalent synchronous tree-adjoining grammars (STAGs) this transformation doubles the grammar’s rank and cubes its size, but in practice the size increase is only quadratic. |
| Approach: | They extend Greibach normal form from CFGs to SCFGs and prove new formal properties about SCFG, a formalism with many applications in natural language processing. |
| Outcome: | The proposed grammars achieve asymptotic and empirical speed improvements on a machine translation task. |
Building a User-Generated Content North-African Arabizi Treebank: Tackling Hell (2020.acl-main)
Copied to clipboard
Djamé Seddah, Farah Essaidi, Amal Fethi, Matthieu Futeral, Benjamin Muller, Pedro Javier Ortiz Suárez, Benoît Sagot, Abhishek Srivastava
| Challenge: | a treebank for a north-African Arabic dialect known for code-switching is made freely available . authors: geopolitical events are a factor highlighting a language deficiency in terms of natural language processing resources . |
| Approach: | They propose to make a treebank for a romanized user-generated content variety of Algerian . they supplement it with 50k unlabeled sentences from common crawl and web-crawled data . |
| Outcome: | The proposed treebank is made of 1500 sentences, fully annotated in morpho-syntax and universal dependency syntax, with full translation at both the word and sentence levels. |
Combining (Second-Order) Graph-Based and Headed-Span-Based Projective Dependency Parsing (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing graph-based methods that score dependency trees do not score dependency arcs at all. |
| Approach: | They propose a headed-span-based method that decomposes the score of a dependency tree into scores of headed spans. |
| Outcome: | The proposed method improves over first-order graph-based methods, but does not score dependency arcs at all. |
Syntactic Nuclei in Dependency Parsing – A Multilingual Exploration (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing models for syntactic dependency parsing assume words are elementary units that enter into dependency relations. |
| Approach: | They propose to use composition functions to make a transition-based dependency parser aware of the notion of nucleus. |
| Outcome: | The proposed concept of nucleus gives small but significant improvements in parsing accuracy on 12 languages. |
How much pretraining data do language models need to learn syntax? (2021.emnlp-main)
Copied to clipboard
| Challenge: | Pretraining methods are convenient, but expensive in terms of time and resources. |
| Approach: | They investigate the impact of pretraining data size on the syntactic capabilities of RoBERTa by using syntaktic structural probes to determine whether models pretrained on more data encode a higher amount of syntastic information. |
| Outcome: | The proposed models perform better on part-of-speech tagging, dependency parsing and paraphrase identification. |
An Untold Story of Preprocessing Task Evaluation: An Alignment-based Joint Evaluation Approach (2024.lrec-main)
Copied to clipboard
Eunkyul Leah Jo, Angela Yoonseo Park, Grace Tianjiao Zhang, Izia Xiaoxiao Wang, Junrui Wang, MingJia Mao, Jungyeul Park
| Challenge: | a preprocessing task such as tokenization and sentence boundary detection (SBD) has been considered as a solution to many NLP challenges . however, the low error rates of current methods are mainly specific to certain tasks and rule-based tokenization can be difficult to use across different systems. |
| Approach: | They propose an evaluation algorithm that combines both tokenization and SBD results to improve evaluation reliability. |
| Outcome: | The proposed evaluation algorithm improves the reliability of evaluations by reevaluating the counts of true positive cases for F1 measures in both preprocessing tasks jointly. |
An Extended Sequence Tagging Vocabulary for Grammatical Error Correction (2023.findings-eacl)
Copied to clipboard
| Challenge: | Current sequence-to-sequence and sequence-tagging approaches treat GEC as a machine-translation problem. |
| Approach: | They propose to introduce specialised tags for spelling correction and morphological inflection using the SymSpell and LemmInflect algorithms. |
| Outcome: | The proposed approach outperforms existing methods on the BEA benchmark. |
An Empirical Study of Incorporating Pseudo Data into Grammatical Error Correction (D19-1)
Copied to clipboard
| Challenge: | incorporating pseudo data in the training of grammatical error correction models has been a key factor in improving performance of such models. |
| Approach: | They investigate the choice of how pseudo data should be generated or used in a grammatical error correction model and show that the results are state-of-the-art. |
| Outcome: | The proposed method achieves state-of-the-art on the CoNLL-2014 test set and the official test set of the BEA-2019 shared task without making any modifications to the model architecture. |
Factuality Assessment as Modal Dependency Parsing (2021.acl-long)
Copied to clipboard
| Challenge: | a critical step towards factuality assessment is to determine the factuality of events in text. |
| Approach: | They propose a modal dependency parsing task that assesses the factuality of events in text . they crowdsource a large-scale data set annotated with modal dependence structures . |
| Outcome: | The proposed model outperforms the pipeline model in factuality assessment . the proposed model is based on a crowdsourced dataset . |
Hexatagging: Projective Dependency Parsing as Tagging (2023.acl-short)
Copied to clipboard
| Challenge: | Using a pretrained language model, we can train language models on increasingly large amounts of data. |
| Approach: | They propose a dependency parser that constructs dependency trees by tagging words with elements from a finite set of possible tags. |
| Outcome: | The proposed approach achieves state-of-the-art performance of 96.4 LAS and 97.4 UAS on the Penn Treebank test set. |
Explicitly Modeling Syntax in Language Models with Incremental Parsing and a Dynamic Oracle (2021.naacl-main)
Copied to clipboard
| Challenge: | Failing to capture the structure of input language could lead to generalization problems and over-parametrization. |
| Approach: | They propose a new syntax-aware language model that explicitly models the structure with an incremental parser and maintains the conditional probability setting of a standard language model. |
| Outcome: | The proposed model can achieve strong results in language modeling, parsing, and syntactic generalization tests while using fewer parameters than other models. |
FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correction (2022.findings-emnlp)
Copied to clipboard
| Challenge: | grammatical error correction (GEC) is a complex task that requires high-quality data from native speakers. |
| Approach: | They propose a human-annotated corpus to detect, identify and correct grammatical errors in Chinese examinations. |
| Outcome: | The proposed model outperforms other models in low-resource settings, but there is a significant gap between the models and humans that encourages future models to bridge it. |
It’s Not What You Say, It’s How You Say It: Evaluating LLM Responses to Expressions of Belief (2026.acl-long)
Copied to clipboard
| Challenge: | a typology is grounded in four linguistically motivated dimensions: form, evidentiality, epistemic stance, and tone. |
| Approach: | They propose a typology to evaluate how different EoBs affect whether models follow context versus prior knowledge. |
| Outcome: | The proposed model systematically evaluates 16 LLMs that differ in architecture, scale, and training stages . human listeners subconsciously interpret the belief based on how it is expressed, i.e., its explicitness, tone, or contextual cues. |
A Unified Span-Based Approach for Opinion Mining with Syntactic Constituents (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for fine-grained opinion mining (OM) are based on span-based annotations, but they are not effective. |
| Approach: | They propose a unified span-based approach for the end-to-end OM setting using syntactic constituents and multi-task learning to integrate them into the proposed model. |
| Outcome: | The proposed approach achieves significant improvements over previous work on the MPQA 2.0 dataset and reduces the number of wrongly-predicted opinion expressions and roles. |
MELA: Multilingual Evaluation of Linguistic Acceptability (2024.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks on linguistic acceptability have been used to evaluate language models' ability to distinguish between acceptable and unacceptable sentences. |
| Approach: | They present the largest benchmark to date on linguistic acceptability: MELA . they establish LLM baselines on this benchmark and investigate cross-lingual transfer in acceptability judgements with XLM-R. |
| Outcome: | The proposed model outperforms open-source models on cross-lingual transfer in acceptability judgements. |
Exact Hard Monotonic Attention for Character-Level Transduction (P19-1)
Copied to clipboard
| Challenge: | Neural sequence-to-sequence models with soft attention outperform monotonic models . current dominant method is the neural sequenceto-Sequency model with soft focus . |
| Approach: | They develop a hard attention sequence-to-sequence model that enforces strict monotonicity and learns alignment jointly. |
| Outcome: | The proposed model achieves state-of-the-art on grapheme-to-phoneme conversion and morphological inflection generation. |
Categorial grammar induction from raw data (2023.findings-acl)
Copied to clipboard
| Challenge: | a new model for categorial grammar induction is based on raw data without part-of-speech information. |
| Approach: | They propose a grammar induction model that learns from raw data without part-of-speech information. |
| Outcome: | a new model for inducing a basic categorial grammar is developed . the model attains a recall-homogeneity of 0.33 on average, and a bias toward forward function application is added . |
A Treebank of Asia Minor Greek (2024.lrec-main)
Copied to clipboard
| Challenge: | Asia Minor Greek (AMG) dialects are endangered because of declining speaker base and scarce linguistic resources. |
| Approach: | They propose to annotate a treebank of Pharasiot Greek, one of the Asia Minor Greek (AMG) dialects. |
| Outcome: | The proposed treebank consists of 350 sentences from six fairy tales in Pharasiot Greek. |
Using LSTMs to Assess the Obligatoriness of Phonological Distinctive Features for Phonotactic Learning (P19-1)
Copied to clipboard
| Challenge: | a recent study has shown that phonetic information is important for phonotactic learning . a feature-naive model outperforms the feature-aware one in terms of probability assigned to a held-out test set of words . |
| Approach: | They compare two recurrent neural network models of phonotactic learning to determine phonetic information in the form of phonological distinctive features. |
| Outcome: | The proposed model outperforms the one with access to distinctive features at the start of learning . the results suggest that distinctive features are not obligatory for learning phonotactic patterns . |
The Effect of Data Partitioning Strategy on Model Generalizability: A Case Study of Morphological Segmentation (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent work to enhance data partitioning strategies for more realistic model evaluations faces challenges in providing a clear optimal choice. |
| Approach: | They analyze morphological segmentation and morphology of ten languages from 19 languages . they use multiple datasets and splits to evaluate models . |
| Outcome: | The proposed model training and evaluation sets and new test data show that models trained from random splits can achieve higher numerical scores and model rankings tend to generalize more consistently. |
Collective Event Detection via a Hierarchical and Bias Tagging Networks with Gated Multi-level Attention Mechanisms (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to ACE event detection treat multiple events in one sentence as independent ones and recognize them separately. |
| Approach: | They propose a hierarchical and bias tagging network framework to detect multiple events in one sentence collectively and a gated multi-level attention mechanism to automatically extract and fuse the sentence-level and document-level information. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on a 2005 ACE dataset. |
ERAS: Evaluating the Robustness of Chinese NLP Models to Morphological Garden Path Errors (2025.naacl-long)
Copied to clipboard
| Challenge: | In languages without orthographic word boundaries, NLP models perform _word segmentation_ as an explicit preprocessing step or as an implicit step in an end-to-end computation. |
| Approach: | They propose a benchmark that tests a model’s vulnerability to morphological garden path errors by comparing its behavior on local segmentation ambiguities. |
| Outcome: | The proposed benchmark compares a model's behavior on sentences with and without local segmentation ambiguities and shows that models with character-level tokenization make implicit garden path errors even without an explicit word segmentation step. |
Synthetic Data Made to Order: The Case of Parsing (D18-1)
Copied to clipboard
| Challenge: | supervised dependency parsing is a core task in natural language processing, but unsupervised parsers can hardly produce useful parses. |
| Approach: | They propose to permute the constituents of an existing dependency treebank so that its surface part-of-speech statistics approximately match those of the target language. |
| Outcome: | The proposed method improves the parsing accuracy of a target language . the proposed method is based on a distribution of gold POS bigrams . |
Dependency Parsing as MRC-based Span-Span Prediction (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for dependency parsing address the issue that edges should be constructed at the text span/subtree level rather than word level. |
| Approach: | They propose a method that constructs dependency trees by directly modeling span-span relations by modeling subtree-subtree relationships. |
| Outcome: | The proposed method constructs dependency trees by modeling span-span relations . it can retrieve missing spans in the span proposal stage, which leads to higher recall . |
How Much Syntactic Supervision is “Good Enough”? (2023.findings-eacl)
Copied to clipboard
| Challenge: | RNNGs with syntactic supervision underperformed RNNs with some syntaktic supervision, whereas RNNS with mild supervision achieved the best performance comparable to the state-of-the-art GPT-2-XL. |
| Approach: | They propose a method where syntactic LMs are gradually ablated from full syntatic supervision to zero syntastic supervision by preserving NP, VP, PP, SBAR nonterminal symbols. |
| Outcome: | The proposed method underperforms the RNNGs with zero syntactic supervision, and the LMs with mild syntaktic supervision perform better than the state-of-the-art GPT-2-XL. |
Recent Trends in Linear Text Segmentation: A Survey (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Linear text segmentation is the task of automatically tagging text documents with topic shifts . the task is based on coherence modeling and/or local cues to identify topic boundaries . |
| Approach: | They provide an overview of current advances in linear text segmentation . they highlight limitations of available resources and of the task itself . |
| Outcome: | The proposed task is based on the most recent literature and under-explored research directions. |
Towards Better Utilization of Multi-Reference Training Data for Chinese Grammatical Error Correction (2024.findings-acl)
Copied to clipboard
| Challenge: | a high proportion of Chinese training data is multi-referenced for the grammatical error correction task . however, there are many ways to correct an erroneous input sentence . a systematic study on multi-referencing training data has been proposed . |
| Approach: | They propose two new approaches and a simple two-stage training strategy to better utilize multi-reference training data. |
| Outcome: | The proposed methods show that Chinese training data contain multiple references. |
Multilingual Word Segmentation: Training Many Language-Specific Tokenizers Smoothly Thanks to the Universal Dependencies Corpus (L18-1)
Copied to clipboard
| Challenge: | Towards language scalability, major progress has been achieved in multilingual language technology in recent years. |
| Approach: | They propose a tokenizer that can be trained from any Universal Dependencies corpus dataset . they argue that tokenization should be seen as a supervised task and scalability requires a software engineering process across languages. |
| Outcome: | The proposed tokenizer can be trained from any dataset in the corpus UD2 . the proposed software tool relies on elephant to perform the training . |
Universal Proposition Bank 2.0 (2022.lrec-1)
Copied to clipboard
Ishan Jindal, Alexandre Rademaker, Michał Ulewicz, Ha Linh, Huyen Nguyen, Khoi-Nguyen Tran, Huaiyu Zhu, Yunyao Li
| Challenge: | Semantic role labeling (SRL) is a shallow semantic parsing task that identifies "who did what to whom when, where etc." SRL is useful in a wide range of downstream NLP tasks and real-world applications. |
| Approach: | They propose a method to generate shallow semantic parsing tasks using monolingual SRL and multilingual parallel data. |
| Outcome: | The proposed method improves the quality of the generated propbanks. |
Parsers Know Best: German PP Attachment Revisited (2020.coling-main)
Copied to clipboard
| Challenge: | PP attachment is one of the major sources of parser errors and is still one of hardest problems for syntactic parsing. |
| Approach: | They present a realistic evaluation of the potential of different PP attachment systems using fully predicted information as system input. |
| Outcome: | The proposed approach is superior to modelling PP attachment disambiguation as a separate task. |
Taking the Correction Difficulty into Account in Grammatical Error Correction Evaluation (2020.coling-main)
Copied to clipboard
| Challenge: | a paper aims to improve performance measures for grammatical error correction . conventional measures treat all errors equally, but some are easier to correct . |
| Approach: | They propose a way to determine the difficulty of error correction and to motivate researchers . paper examines performance measures for grammatical error correction using a scorer and weighting algorithm . |
| Outcome: | The proposed measures agree with our intuition of correction difficulty . the results show that the measures are more complex than conventional measures . |
Improving Automatic Grammatical Error Annotation for Chinese Through Linguistically-Informed Error Typology (2025.coling-main)
Copied to clipboard
| Challenge: | In educational settings, GEC systems provide immediate and consistent feedback to both native (L1) and non-native (L2) language learners. |
| Approach: | They propose a framework that provides detailed feedback on 12-16% of all errors by identifying them under a new error typology, specific enough to uncover subtle differences in error patterns between L1 and L2 writings. |
| Outcome: | The proposed framework can provide detailed feedback on 12-16% of all errors, revealing subtle differences in error patterns between L1 and L2 writings. |
Auxiliary tasks to boost Biaffine Semantic Dependency Parsing (2022.findings-acl)
Copied to clipboard
| Challenge: | Semantic dependency parsing (SDP) is a task of producing a dependency graph for a sentence. |
| Approach: | They propose to use simple auxiliary tasks that introduce some form of interdependence between arcs to circumvent such an independence of decision. |
| Outcome: | The proposed method shows modest but systematic performance gains on a near-state-of-the-art baseline using transformer-based contextualized representations. |
Representations and Architectures in Neural Sentiment Analysis for Morphologically Rich Languages: A Case Study from Modern Hebrew (C18-1)
Copied to clipboard
| Challenge: | Existing sentiment analyzers for MRLs that use tokens and morpheme-based representations have no empirically studied effects of representation choices on neural sentiment analysis. |
| Approach: | They develop a sentiment analysis benchmark for Hebrew based on 12K social media comments and provide two instances of data. |
| Outcome: | The proposed benchmarks show that representation choices have measurable effects on task perfromance and that they vary depending on architecture type. |
Multilingual Blending: Large Language Model Safety Alignment Evaluation with Language Mixture (2025.findings-naacl)
Copied to clipboard
| Challenge: | a range of representative Large Language Models have exhibited remarkable generalization capabilities across numerous downstream tasks. |
| Approach: | They propose a query-response scheme to evaluate the safety alignment of LLMs . they found that multilingual query-responding significantly amplifies the detriment of malicious queries . |
| Outcome: | The proposed scheme improves the safety alignment of state-of-the-art LLMs under multilingual conditions. |
Neural text normalization leveraging similarities of strings and sounds (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods that ignore the similarities of word strings and sounds do not account for these features. |
| Approach: | They propose a neural model that considers the similarities of both word strings and sounds, and a model that takes only the similarity of word strings or of sounds as a baseline. |
| Outcome: | The proposed models outperformed a baseline model and achieved state-of-the-art results on WNUT-2015. |
Neural Combinatory Constituency Parsing (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to constituency parsing are based on symbolic engineering, but they are simplified by their adaptive distributed representation. |
| Approach: | They propose two fast combinatory models for constituency parsing: binary and multibranching. |
| Outcome: | The proposed models achieve an F1 score of 92.54 on Penn Treebank, speeding at 1327.2 sents/sec. |
DeepCx: A transition-based approach for shallow semantic parsing with complex constructional triggers (D18-1)
Copied to clipboard
| Challenge: | Using DeepCx, we extend Shallow semantic parsing to include complex constructions . multi-word expressions and complex constructional arguments can express relational meanings - but little work has addressed tagging of such constructional triggers. |
| Approach: | They propose a neural-based surface construction labeling task that extends Shallow Semantic Parsing to include frames triggered by complex constructions. |
| Outcome: | The proposed system improves on the task of tagging causal language in English. |
Lexical Normalization for Code-switched Data and its Effect on POS Tagging (2021.eacl-main)
Copied to clipboard
| Challenge: | Social media data can be used to improve natural language processing performance, but it is often overlooked by lexical normalization systems. |
| Approach: | They propose three lexical normalization models specifically designed to handle code-switched data and evaluate their performance on POS tags. |
| Outcome: | The proposed models outperform monolingual models and lead to 5.4% performance increase for POS tagging compared to unnormalized input. |
ReBPE: Iteratively Improving the Internal Structure of a Structured Tokeniser by Mining its Internal Structure (2026.findings-eacl)
Copied to clipboard
| Challenge: | Recent work explores pruning merges from BPE subword tokenisers using corpus data as a signal for which merges to prune. |
| Approach: | They propose a pruning algorithm that inspects the effects left by pruning . they propose reification of the tokenisers and a new pruning algorithm . |
| Outcome: | The proposed algorithm outperforms the original BPE-knockout algorithm on alignment in all 14 languages tested by over 11% F1 on average. |
Parsing Gapping Constructions Based on Grammatical and Semantic Roles (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for parsing sentences with gapping recover elided elements from redundant elements . grammatical and semantic tags are used to identify gaps in a coordinated structure . |
| Approach: | They propose a method of parsing sentences with gapping to recover elided elements . they use constituent trees annotated with grammatical and semantic roles . |
| Outcome: | The proposed method outperforms the previous method in terms of F-measure and recall. |
Span-based discontinuous constituency parsing: a family of exact chart-based algorithms with time complexities from O(nˆ6) down to O(nˆ3) (2020.emnlp-main)
Copied to clipboard
| Challenge: | a novel chart-based parser for discontinuous constituency trees is proposed for span-based span parsing . it can process discontinuous constituent trees of block degree two, including ill-nested structures . |
| Approach: | They propose a chart-based algorithm for span-based parsing of discontinuous constituency trees . they build variants with smaller search spaces and time complexities ranging from O(n6) down to O(N3) . |
| Outcome: | The proposed algorithm can process 98% of constituents in linguistic treebanks while having the same complexity as continuous constituency parsers. |
Fine-grained Semantic Textual Similarity for Serbian (L18-1)
Copied to clipboard
| Challenge: | Semantic textual similarity (STS) is a task of assigning a numerical score to short texts based on the level of semantic equivalence between them. |
| Approach: | They propose to annotate Serbian STS dataset with fine-grained similarity scores . they propose a supervised bag-of-words model that combines part-of speech weighting with term frequency weighting . |
| Outcome: | The proposed model outperforms existing models on the Serbian STS News Corpus . the proposed model is based on a new morphologically rich language . |
Some Languages Seem Easier to Parse Because Their Treebanks Leak (2020.emnlp-main)
Copied to clipboard
| Challenge: | Cross-language differences in (universal) dependency parsing performance are mostly attributed to treebank size, average sentence length, average dependency length, morphological complexity, and domain differences. |
| Approach: | They compute graph isomorphisms and find that treebank size is a factor that influences parsing performance. |
| Outcome: | The results show that the overlap between training and test graphs explain more of the observed variation than standard explanations such as the above. |
On the Computational Modelling of Michif Verbal Morphology (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing computational models of the verbal morphology of the Métis language are insufficient to model the language's unique phonological interactions. |
| Approach: | They propose a finite-state computational model of the verbal morphology of Michif . they use composed finite state transducers to model concatenative morphologies . |
| Outcome: | The proposed model is based on a series of finite-state transducers. |
Compound Probabilistic Context-Free Grammars for Grammar Induction (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to grammar induction have resorted to manually-engineered features and auxiliary objectives to induce the desired structures. |
| Approach: | They propose a formalization of the grammar induction problem that models sentences as being generated by a compound probabilistic context free grammar. |
| Outcome: | Experiments on English and Chinese show that the proposed approach is more efficient than other methods. |
Edit-Wise Preference Optimization for Grammatical Error Correction (2025.coling-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been successful in grammatical error correction (GEC) but their strengths have yet to be fully demonstrated in GEC . |
| Approach: | They propose a method to optimize grammatical errors by assigning higher reward weights to edit tokens during preference optimization. |
| Outcome: | The proposed method outperforms baselines on English and Chinese datasets and achieves state-of-the-art performance. |
Detecting Syntactic Change with Pre-trained Transformer Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a fine-tuned BERT model can distinguish between text from the early 1800s and late 1900s . we use it to identify specific instances of syntactic change and specific words for which a new part of speech was introduced. |
| Approach: | They propose to use a BERT-based model to find syntactic differences between English of the early 1800s and that of the late 1900s. |
| Outcome: | The proposed model can distinguish between English of the early 1800s and that of the late 1900s using only syntactic information. |
Consistent Autoformalization for Constructing Mathematical Libraries (2024.emnlp-main)
Copied to clipboard
| Challenge: | Autoformalization is the task of automatically translating mathematical content written in natural language to a formal language expression. |
| Approach: | They propose to use three mechanisms to improve autoformalization quality . they propose to combine most-similar retrieval augmented generation, denoising steps and auto-correction with syntax error feedback to improve syntactic, terminological and semantic control. |
| Outcome: | The proposed mechanisms can deliver syntactically, terminologically and semantically more consistent results across different models. |
Grid Tagging Scheme for Aspect-oriented Fine-grained Opinion Extraction (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Aspect-oriented Fine-grained Opinion Extraction (AFOE) aims to extract aspect terms and opinion terms from review text in the form of opinion pairs or opinion triplets. |
| Approach: | They propose a grid-based AFOE tagging scheme to address the task in an end-to-end fashion only with one unified grid tracking task. |
| Outcome: | The proposed tagging scheme outperforms baselines and achieves state-of-the-art performance. |
Incorporating Syntax and Frame Semantics in Neural Network for Machine Reading Comprehension (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for machine reading comprehension rely on manually defined features and are difficult to generalize to other tasks. |
| Approach: | They propose a Syntax and Frame Semantics model for Machine Reading Comprehension which takes full advantage of syntax and frame semantics to get richer text representation. |
| Outcome: | The proposed model outperforms ten state-of-the-art models on machine reading comprehension tasks. |
BanLemma: A Word Formation Dependent Rule and Dictionary Based Bangla Lemmatizer (2023.findings-emnlp)
Copied to clipboard
Sadia Afrin, Md. Shahad Mahmud Chowdhury, Md. Islam, Faisal Khan, Labib Chowdhury, Md. Mahtab, Nazifa Chowdhury, Massud Forkan, Neelima Kundu, Hakim Arif, Mohammad Mamun Or Rashid, Mohammad Amin, Nabeel Mohammed
| Challenge: | Lemmatization holds significance in both natural language processing (NLP) and linguistics due to the highly inflected nature and morphological richness of Bangla text. |
| Approach: | They propose linguistic rules for lemmatization and utilize a dictionary along with the rules to design a lemma specifically for Bangla. |
| Outcome: | The proposed system achieves 96.36% accuracy when tested against a manually annotated test dataset. |
Camel Morph MSA: A Large-Scale Open-Source Morphological Analyzer for Modern Standard Arabic (2024.lrec-main)
Copied to clipboard
| Challenge: | Camel Morph MSA is the largest open-source Modern Standard Arabic morphological analyzer and generator. |
| Approach: | They present Camel Morph MSA, the largest open-source Arabic morphological analyzer and generator. |
| Outcome: | The analysis can produce 1.45B analyses and 535M unique diacritizations, almost an order of magnitude larger than SAMA on a 10B word corpus. |
C-HTS: A Concept-based Hierarchical Text Segmentation approach (L18-1)
Copied to clipboard
| Challenge: | Existing approaches to hierarchical text segmentation use lexical and/or syntactic similarity to identify the coherent segments of text. |
| Approach: | They propose a Concept-based Hierarchical Text Segmentation approach that uses the semantic relatedness between text constituents to represent meaning. |
| Outcome: | The proposed method performs well on two publicly available datasets. |
Universal Dependencies According to BERT: Both More Specific and More General (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies show that individual BERT heads encode particular dependency relation types, but they do not match one-to-one. |
| Approach: | They propose a method for relation identification and syntactic tree construction that can be applied with minimal supervision and generalizes well across languages. |
| Outcome: | The proposed method produces significantly more consistent dependency trees than previous work and can be applied with only a minimal amount of supervision and generalizes well across languages. |
Neural Factor Graph Models for Cross-lingual Morphological Tagging (P18-1)
Copied to clipboard
| Challenge: | Existing approaches to morphological tagging are limited by the assumption that tag sets overlap . a limited amount of data is available for most languages to learn these morphology taggers. |
| Approach: | They propose a method for cross-lingual morphological tagging that relaxes this assumption . they use factorial conditional random fields with neural network potentials to smooth over superficial differences in the surface forms . |
| Outcome: | The proposed model can smooth over superficial differences in the surface forms and generate unseen or rare tag sets. |
Global Transition-based Non-projective Dependency Parsing (P18-1)
Copied to clipboard
| Challenge: | Until recently, transition-based dependency parsers were limited to approximate inference due to their incompatibility with rich feature models. |
| Approach: | They propose a transition-based parser with high coverage on non-projective treebanks to support non- projective parsing. |
| Outcome: | The proposed approach is more efficient than its projective counterpart in non-projective languages. |
A Universal Dependencies Treebank of Ancient Hebrew (2022.lrec-1)
Copied to clipboard
| Challenge: | Using a rule-based parser, we construct a treebank with morphological annotations of Ancient Hebrew . the Hebrew Scriptures are a collection of 39 books written in the first millennium BC in Ancient Hebrew. |
| Approach: | They propose to use a Universal Dependencies treebank with morphological annotations of Ancient Hebrew for comparative study with ancient translations and analysis of Hebrew syntax. |
| Outcome: | The proposed treebank can be used in comparative study with ancient translations and analysis of Hebrew syntax. |
Type-Driven Multi-Turn Corrections for Grammatical Error Correction (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on data augmentation to combat exposure bias . but data augmented models lack the ability to recognize the procedure of gradual corrections . |
| Approach: | They propose a type-driven multi-turn corrections approach that uses multiple training instances to train dominant models. |
| Outcome: | The proposed model achieves state-of-the-art single-model performance on English GEC benchmarks. |
Generic refinement of expressive grammar formalisms with an application to discontinuous constituent parsing (C18-1)
Copied to clipboard
| Challenge: | a split/merge algorithm for interpreted regular tree grammars is a generalization of Petrov et al. (2006) . |
| Approach: | They propose to use a split/merge algorithm for interpreted regular tree grammars to refine a large class of grammar formalisms. |
| Outcome: | The proposed algorithm captures a large class of grammar formalisms and is able to refine natural sets of nonterminals. |
BDPROTO: A Database of Phonological Inventories from Ancient and Reconstructed Languages (L18-1)
Copied to clipboard
| Challenge: | BDPROTO is a database of phonological inventory data from 137 ancient and reconstructed languages. |
| Approach: | They present a database of phonological inventory data from 137 ancient and reconstructed languages. |
| Outcome: | The BDPROTO database is a publicly available, unicode-compliant resource . it contains phonological inventory data from 137 ancient and reconstructed languages . |
Attention Can Reflect Syntactic Structure (If You Let It) (2021.eacl-main)
Copied to clipboard
| Challenge: | a recent study has attempted to decode linguistic structure from the Transformer . but, much of the work focused on English, a language with rigid word order and a lack of inflectional morphology. |
| Approach: | They propose to fine-tune a feature encoder for BERT to learn linguistic structure from its multi-head attention mechanism. |
| Outcome: | The proposed model can decode full trees above baseline accuracy from single attention heads across languages. |
Learning the Ordering of Coordinate Compounds and Elaborate Expressions in Hmong, Lahu, and Chinese (2022.naacl-main)
Copied to clipboard
| Challenge: | phonological hierarchies that predict coordinate constructions are often phonetically “natural” . a neural sequence labeling model can learn elaborate expressions in Hmong without using phonology information. |
| Approach: | They propose that coordinate compounds and elaborate expressions can be learned empirically by phonological hierarchies and a neural sequence labeling model can learn the ordering of elaborate expression in Hmong without using phonology. |
| Outcome: | The proposed models beat strong baselines for all three languages and learn hierarchies similar to those proposed by Mortensen. |
Unified Grid Tagging Scheme for Aspect Sentiment Quad Prediction (2025.coling-main)
Copied to clipboard
| Challenge: | Existing table-filling methods decompose the ASQP task into subtasks without considering the association between sentiment elements. |
| Approach: | They propose a simple yet effective Unified Grid Tagging Scheme to extract sentiment quadruplets in one shot . they leverage syntactic dependency tree and AMR graph to enrich association between sentiment elements . |
| Outcome: | The proposed model extracts all sentiment elements in quads for a given review to explain the reason for the sentiment. |
Is Supervised Syntactic Parsing Beneficial for Language Understanding Tasks? An Empirical Investigation (2021.eacl-main)
Copied to clipboard
| Challenge: | Traditional NLP has long held (supervised) syntactic parsing necessary for successful higher-level semantic language understanding (LU). |
| Approach: | They empirically examine the usefulness of supervised parsing for semantic LU in LM-pretrained transformer networks. |
| Outcome: | The proposed model is based on LM-pretrained transformer networks with a biaffine parsing head and fine-tuned for LU tasks. |
PoSTWITA-UD: an Italian Twitter Treebank in Universal Dependencies (L18-1)
Copied to clipboard
Manuela Sanguinetti, Cristina Bosco, Alberto Lavelli, Alessandro Mazzei, Oronzo Antonelli, Fabio Tamburini
| Challenge: | Various approaches and ad hoc resources are needed to provide proper coverage of specific linguistic phenomena. |
| Approach: | They propose to annotate tweets using a well-known dependency-based annotation format . they propose to use the tweets for training NLP systems to improve their performance . |
| Outcome: | The proposed resource can be used for training of NLP systems on social media texts. |
IndoCollex: A Testbed for Morphological Transformation of Indonesian Colloquial Words (2021.findings-acl)
Copied to clipboard
Haryo Akbarianto Wibowo, Made Nindyatama Nityasya, Afra Feyza Akyürek, Suci Fitriany, Alham Fikri Aji, Radityo Eko Prasojo, Derry Tanti Wijaya
| Challenge: | Existing research on word normalization in Indonesian language relies on static dictionaries and machine translation. |
| Approach: | They propose to use Twitter to annotate Indonesian colloquial words with their standard forms and their word formation types/tags to perform morphological word normalization. |
| Outcome: | The proposed dataset analyzes morphological word normalization on Indonesian colloquial Lexicons and provides a baseline for future work. |
Shrinking Japanese Morphological Analyzers With Neural Networks and Semi-supervised Learning (N19-1)
Copied to clipboard
| Challenge: | Modern neural morphological analyzers consume gigabytes of memory. |
| Approach: | They propose a method which uses unigram character embeddings to train a model on labels produced by a state-of-the-art analyzer. |
| Outcome: | The proposed model outperforms dictionary-based methods in Japanese and Chinese . it uses less than 15 megabytes of space and is much smaller than the dictionary- based one . |
Lightweight Grammatical Annotation in the TEI: New Perspectives (L18-1)
Copied to clipboard
| Challenge: | a small set of descriptive devices have been made available for lightweight linguistic annotation . merit of a predefined TEI tagset is the homogeneity of tagging and better interoperability of simple linguistic resources encoded in the TE. |
| Approach: | They propose a new attribute class that would gather token-level attributes facilitating simple linguistic annotation. |
| Outcome: | The proposed attribute class addresses community feedback on the lack of a specific tagset for lightweight linguistic annotation within the TEI. |
Explicit Alignment Objectives for Multilingual Bidirectional Encoders (2021.naacl-main)
Copied to clipboard
| Challenge: | Pre-trained cross-lingual encoders have proven impressively effective at enabling transfer-learning of NLP systems from high-resource languages to low-resourced languages. |
| Approach: | They propose a method to align multilingual encoders using two explicit alignment objectives that align the multilingual representations at different granularities. |
| Outcome: | The proposed method achieves gains of up to 1.1 average F1 score on sequence tagging and 27.3 average accuracy on retrieval over the XLM-R-large model. |
Camel Treebank: An Open Multi-genre Arabic Dependency Treebank (2022.lrec-1)
Copied to clipboard
| Challenge: | CAMELTB is an open-source dependency treebank of Arabic with 13 sub-corpora . texts are publicly available (out of copyright, creative commons, or under open licenses) |
| Approach: | They present the Camel Treebank, a 188K word open-source dependency treebank of Arabic. |
| Outcome: | The CAMELTB is a 188K word open-source dependency treebank of Arabic . the texts are publicly available (out of copyright, creative commons, or under open licenses) |
Grammatical Error Correction as GAN-like Sequence Labeling (2021.findings-acl)
Copied to clipboard
| Challenge: | Traditional GEC models learn from sentences with fixed error rates . sequence labeling approaches suffer from a couple of key problems . |
| Approach: | They propose a GAN-like sequence labeling model with a grammatical error detector and a generator to correct grammamatical errors. |
| Outcome: | The proposed model improves the state-of-the-art in GEC and improves on benchmarks. |
An Investigation of the Interactions Between Pre-Trained Word Embeddings, Character Models and POS Tags in Dependency Parsing (D18-1)
Copied to clipboard
| Challenge: | Existing studies have shown that character models are less important in the presence of word embeddings, but combining them quickly leads to diminishing returns. |
| Approach: | They propose to combine pre-trained word embeddings, character models and POS tags to improve parsing quality by categorising words by frequency, POS tag and language. |
| Outcome: | The proposed system improves on initialised word embeddings but combines them quickly leads to diminishing returns. |
CCTC: A Cross-Sentence Chinese Text Correction Dataset for Native Speakers (2022.coling-1)
Copied to clipboard
| Challenge: | Chinese text correction datasets focus on detecting and correcting Chinese spelling errors and grammatical errors. |
| Approach: | They propose a Chinese text correction dataset for native speakers . they manually annotated 1,500 Chinese texts written by native speakers. |
| Outcome: | The proposed dataset can detect and correct Chinese spelling errors and grammatical errors. |
A Novel Challenge Set for Hebrew Morphological Disambiguation and Diacritics Restoration (2020.findings-emnlp)
Copied to clipboard
| Challenge: | morphological parsers face a formidable challenge with unbalanced ambiguities in homographs . case of unbalanciated ambiguity is difficult to disambiguate, especially in cases of unbalancing . a new dataset improves the overall average F1 score for Hebrew homograph . |
| Approach: | They propose a challenge set for Hebrew homographs with substantial attestation of each analysis of 21 Hebrew homographies. |
| Outcome: | The proposed set improves the average F1 score for Hebrew homographs by 0.67 . the annotated datasets are made publicly available for further research. |
Constructing a Lexical Resource of Russian Derivational Morphology (2022.lrec-1)
Copied to clipboard
| Challenge: | In Natural Language Processing of Russian, the inflection is satisfactorily processed, but there are only a few machine-trackable resources that capture derivations . |
| Approach: | They propose to use machine-learning methods to improve Russian inflection and derivational resources by using a database of more than 300 thousand lexemes and 164 thousand binary derivations. |
| Outcome: | The proposed method includes more than 300 thousand lexemes connected with more than 164 thousand binary derivational relations. |
Building a Macro Chinese Discourse Treebank (L18-1)
Copied to clipboard
| Challenge: | Discourse structure analysis is an important research topic in natural language processing. |
| Approach: | They propose to construct a macro discourse structure framework and annotate 147 Newswire articles. |
| Outcome: | The proposed framework can lay the foundation for further analysis of macro discourse structure. |
From characters to words: the turning point of BPE merges (2021.eacl-main)
Copied to clipboard
| Challenge: | morphological complexity is still a major challenge for NLP and the study of language. |
| Approach: | They perform a cross-linguistic comparison following incremental merges of BPE for 47 diverse languages. |
| Outcome: | The results show that language distributions are similar under specific levels of tokenization. |
CoBaLD Annotation: The Enrichment of the Enhanced Universal Dependencies with the Semantical Pattern (2024.lrec-main)
Copied to clipboard
| Challenge: | a new annotation format is developed to support morphological, syntactic and semantic markup . the format is based on the Compreno semantics, which is a simplified version of the standard . |
| Approach: | They propose a new annotation format that combines Enhanced UD morphosyntax and Compreno semantic pattern to enrich the UD annotation with word meanings and labels for semantic relations between words. |
| Outcome: | The proposed format is aimed at morphological, syntactic and especially semantic markup . the proposed format reduces the number of semantic fields denoting lexical meanings . |
Word Segmentation by Separation Inference for East Asian Languages (2022.findings-acl)
Copied to clipboard
| Challenge: | Chinese Word Segmentation (CWS) is a sequence labeling task that divides sentences into words . despite diverse tagging schemas, they all carry implicit position information. |
| Approach: | They propose to model the separation state of every two consecutive characters by tagging them as two tags. |
| Outcome: | The proposed framework outperforms state-of-the-art on Japanese and Korean Word Segmentation datasets. |
Biomedical term normalization of EHRs with UMLS (L18-1)
Copied to clipboard
| Challenge: | Currently, there is no tool for this language and for this specific purpose. |
| Approach: | They propose a multilingual and cross-lingual tool that searches for biomedical terms in clinical texts with the Unified Medical Language System (UMLS) Metathesaurus. |
| Outcome: | The proposed tool performs biomedical term normalization in clinical texts with the unified medical language system (UMLS) Metathesaurus . it is based on Apache Lucene TM and is available on-line 2 . |
Constructing a Dependency Treebank for Second Language Learners of Korean (2024.lrec-main)
Copied to clipboard
| Challenge: | a manually annotated syntactic treebank is available for second language learners . the dataset includes 7,530 sentences (66,982 words; 129,333 morphemes) |
| Approach: | They propose to manually annotate syntactic treebanks based on Universal Dependencies from Korean written data. |
| Outcome: | The proposed dataset includes 7,530 sentences and 129,333 morphemes from Korean learners. |
Women’s Syntactic Resilience and Men’s Grammatical Luck: Gender-Bias in Part-of-Speech Tagging and Dependency Parsing (P19-1)
Copied to clipboard
| Challenge: | linguistic studies have shown the prevalence of various lexical and grammatical patterns in texts authored by a person of a particular gender, but models for part-of-speech tagging and dependency parsing have not adapted to account for these differences. |
| Approach: | They annotate the Wall Street Journal part of the Penn Treebank with the gender information of the articles’ authors and build taggers and parsers trained on this data. |
| Outcome: | The proposed model can account for gendered differences in syntactic tasks and highlight future venues for developing more accurate taggers and parsers. |
Better, Faster, Stronger Sequence Tagging Constituent Parsers (N19-1)
Copied to clipboard
| Challenge: | Existing efforts to speed up constituent parsing have focused on chart-based or shift-reduce parsers. |
| Approach: | They propose to use auxiliary losses and sentence-level fine-tuning to mitigate greedy decoding issues. |
| Outcome: | The proposed model surpasses the performance of sequence tagging constituent parsers on the English and Chinese Penn Treebank datasets and reduces their parsing time even further. |
BKTreebank: Building a Vietnamese Dependency Treebank (L18-1)
Copied to clipboard
| Challenge: | In this paper, we present the building of a dependency treebank for Vietnamese . |
| Approach: | They propose to build a Vietnamese dependency treebank using automatic taggers and automatic tagging. |
| Outcome: | The proposed treebank is a useful resource for Vietnamese language processing. |
A Resource for Studying Chatino Verbal Morphology (2020.lrec-1)
Copied to clipboard
| Challenge: | a recent study focused on the verbal inflectional morphology of a mesoamerican language, San Juan Quiahije Chatino . low-resource endangered languages are left behind, while high-resourced ones are left out . a new approach to document endangered languages is needed to ensure language use continues . |
| Approach: | They present a resource focusing on the verbal inflectional morphology of a mesoamerican language . they use morphological inflection tables and baseline results to assess the language's morphologies . |
| Outcome: | The proposed resource focuses on the verbal inflectional morphology of a mesoamerican language . the authors show that the results are consistent with the current state of the art in the field . |
Unlike “Likely”, “Unlike” is Unlikely: BPE-based Segmentation hurts Morphological Derivations in LLMs (2025.coling-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) use subword vocabularies to process and generate text. |
| Approach: | They find that Large Language Models (LLMs) perform poorly at handling some types of affixations because subwords are marked as initial- or intra-word . |
| Outcome: | The largest models trained on enough data can mitigate this tendency because initial- and intra-word embeddings are aligned; in-context learning also helps when all examples are selected in a consistent way; but only morphological segmentation can achieve a near-perfect accuracy. |
Training-Free Text Emotion Tagging via LLM-Based Best-Worst Scaling (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are often used as automatic annotators for tasks such as Text Emotion Recognition (TER). |
| Approach: | They propose a novel algorithm that leverages Best-Worst Scaling to prompt the LLM to choose the least and most suitable emotions for a given text from several label subsets. |
| Outcome: | The proposed method compares favorably to existing methods and naive prompting approaches in terms of accuracy and calibration. |
FonBund: A Library for Combining Cross-lingual Phonological Segment Data (L18-1)
Copied to clipboard
| Challenge: | Speech and language technology is currently only available for a tiny fraction of the world's languages. |
| Approach: | They propose to map phonetic segments in International Phonetic Alphabet into multiple articulatory feature representations using a free-source library. |
| Outcome: | The proposed library can be easily modified to support new phonological segment inventories. |
CantoMap: a Hong Kong Cantonese MapTask Corpus (2020.lrec-1)
Copied to clipboard
| Challenge: | a corpus of connected spoken Hong Kong Cantonese is constructed to study the phonology and semantics of the language. |
| Approach: | They propose to build a corpus of connected spoken Hong Kong Cantonese with phonemic transcription and controlled elicitation tasks. |
| Outcome: | The proposed corpus contains 768 minutes of recordings and transcripts of forty speakers. |
Studying the Inductive Biases of RNNs with Synthetic Variations of Natural Languages (N19-1)
Copied to clipboard
| Challenge: | Recent studies have identified both strengths and limitations of recurrent neural networks (RNNs) in applied natural language processing tasks. |
| Approach: | They propose a paradigm that addresses typological differences between languages . they create synthetic versions of English and train them to predict agreement features . |
| Outcome: | The proposed model improves on predicting agreement with subject and object, suggesting that RNNs have a recency bias. |
The UD-NewsCrawl Treebank: Reflections and Challenges from a Large-scale Tagalog Syntactic Annotation Project (2025.acl-long)
Copied to clipboard
| Challenge: | UD-NewsCrawl is the largest Tagalog treebank to date, with 15.6k trees manually annotated according to the Universal Dependencies framework. |
| Approach: | They propose to use UD-NewsCrawl to annotate Tagalog trees using the Universal Dependencies framework. |
| Outcome: | The proposed treebanks are based on the Universal Dependencies framework and have 15.6k trees annotated manually. |
New Dataset and Strong Baselines for the Grammatical Error Correction of Russian (2021.findings-acl)
Copied to clipboard
| Challenge: | a new resource is created to evaluate grammatical error correction models in English . a subset of the dataset is annotated in Russian, which is hard to come by and expensive to annotate . |
| Approach: | They develop an annotated learner corpus of Russian extracted from the Lang-8 website. |
| Outcome: | The proposed dataset is compared against two state-of-the-art grammatical error correction models . the results show that the created corpus is more diverse than the existing one . |
Building a TOCFL Learner Corpus for Chinese Grammatical Error Diagnosis (L18-1)
Copied to clipboard
| Challenge: | Annotated learner corpus is valuable for research in second language acquisition, foreign language teaching, and contrastive interlanguage analysis. |
| Approach: | They construct a TOCFL learner corpus and use it for Chinese grammatical error diagnosis. |
| Outcome: | The constructed corpus is available to the public and will be used for shared tasks on Chinese grammatical error diagnosis. |
Adapting Word Embeddings to New Languages with Morphological and Phonological Subword Representations (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to generalization to resource-rich languages are difficult . a recent study shows that word representations can be useful in low resource languages . |
| Approach: | They propose two approaches for improving generalization to low-resource languages by adapting continuous word representations using linguistically motivated subword units. |
| Outcome: | The proposed method improves generalization to low resource languages . it requires neither parallel corpora nor bilingual dictionaries and requires no parallel training . |
Developing New Linguistic Resources and Tools for the Galician Language (L18-1)
Copied to clipboard
| Challenge: | Existing resources and tools for the Galician language are lacking for other less-resourced languages, such as statistical tools for lemmatization and Named Entity Recognition. |
| Approach: | They propose to develop a manually revised corpus for POS tagging and lemmatization, and a new manually annotated corpus to train existing statistical tools for the Galician language. |
| Outcome: | The proposed resources include a new corpus for POS tagging and lemmatization, and a manually annotated corpus to handle Named Entity recognition. |
Detection and Measurement of Syntactic Templates in Generated Text (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing diversity evaluation focuses primarily on word-level features. |
| Approach: | They propose a method for evaluating diversity over syntactic features to characterize general repetition in large language models. |
| Outcome: | The proposed method shows that models produce templated text in downstream tasks at a higher rate than what is found in human-reference texts. |
PSET: a Phonetics-Semantics Evaluation Testbed (2025.emnlp-main)
Copied to clipboard
| Challenge: | Phonetic embeddings are a powerful tool for capturing the meaning of text . they are not ideal for tasks centered on sound, such as finding sound analogies . |
| Approach: | They propose a phonetic-semantics evaluation testbed to evaluate phonetic embeddings . they use phonetic embedded models to test phonetic models . |
| Outcome: | The phonetic embeddings solve the task with varying degrees of success . the phonetic-based embeddables perform better than the other models . |
Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error Correction (2021.acl-long)
Copied to clipboard
| Challenge: | Experimental results demonstrate the effectiveness of Tail-to-Tail (TtT) non-autoregressive sequence prediction for Chinese Grammatical Error Correction (CGEC) |
| Approach: | They propose a framework for Chinese Grammatical Error Correction (CGEC) that uses a BERT-initialized Transformer Encoder to model the error positions. |
| Outcome: | The proposed framework solves the problem of Chinese Grammatical Error Correction (CGEC) by modeling the token dependencies. |
A Large-Scale Comparison of Historical Text Normalization Systems (N19-1)
Copied to clipboard
| Challenge: | a large study of historical text normalization is done on eight languages . there is no consensus on the state-of-the-art approach to normalization . |
| Approach: | They present a large study of historical text normalization done on eight languages . they evaluate four different systems based on supervised learning on datasets from eight different languages based in the literature . |
| Outcome: | The proposed methods are based on supervised learning and are available online. |
Please Mind the Root: Decoding Arborescences for Dependency Parsing (2020.emnlp-main)
Copied to clipboard
| Challenge: | a dependency tree has a root constraint, but only one edge may emanate from the root node. |
| Approach: | They propose an algorithm which enforces a root constraint without compromising the original runtime. |
| Outcome: | The proposed algorithm satisfies the constraint without compromising the original runtime. |
Typological Features for Multilingual Delexicalised Dependency Parsing (N19-1)
Copied to clipboard
| Challenge: | Existing universal models to describe the syntax of languages are debated for decades . a new study examines the plausibility of universal grammars in dependency parsing . |
| Approach: | They propose to use typological features to describe the syntax of languages to train a multilingual dependency parser. |
| Outcome: | The proposed model can be trained on 40 languages with the help of typological features. |
Annotating Chinese Light Verb Constructions according to PARSEME guidelines (L18-1)
Copied to clipboard
| Challenge: | Using existing resources, we can annotate Chinese multiword expressions using PARSEME guidelines. |
| Approach: | They propose to use an existing resource containing Chinese light verbs to make an annotation of a Chinese UD treebank in two steps. |
| Outcome: | The proposed annotations are based on an existing treebank containing Chinese light verbs and are consistent with the proposed guidelines. |
Neural Grammatical Error Correction with Finite State Transducers (N19-1)
Copied to clipboard
| Challenge: | Language model based GEC (LM-GEC) is a promising alternative to SMT and neural sequence-to-sequence models. |
| Approach: | They propose to use finite state transducers to improve LM-GEC by rescoring with neural language models. |
| Outcome: | The proposed model outperforms the best published results on the CoNLL-2014 test set and achieves far better relative improvements over the baselines. |
Building an Endangered Language Resource in the Classroom: Universal Dependencies for Kakataibo (2022.lrec-1)
Copied to clipboard
Roberto Zariquiey, Claudia Alvarado, Ximena Echevarría, Luisa Gomez, Rosa Gonzales, Mariana Illescas, Sabina Oporto, Frederic Blum, Arturo Oncevay, Javier Vera
| Challenge: | 12 This paper describes the collaborative methodology implemented to create a UD treebank for a Peruvian endangered language. |
| Approach: | They propose to create a UD treebank for a Peruvian endangered language . they use a collaborative methodology to create the treebank in a course . |
| Outcome: | The proposed treebank would enhance the future development of an NLP toolkit for this endangered language. |
Syntactic Scaffolds for Semantic Structures (D18-1)
Copied to clipboard
| Challenge: | Syntactic scaffolds avoid expensive syntactical processing at runtime . many systems have used syntastic dependency or phrase-based parsers as preprocessing for semantic analysis. |
| Approach: | They propose a multitask learning approach that uses a syntactic treebank to integrate syntaktic information into semantic tasks. |
| Outcome: | The proposed method improves on PropBank semantics, frame semantics and coreference resolution tasks. |
K-UniMorph: Korean Universal Morphology and its Feature Schema (2023.findings-acl)
Copied to clipboard
| Challenge: | Previously, the Korean language has been underrepresented in the field of morphological paradigms amongst hundreds of diverse world languages. |
| Approach: | They propose a new Universal Morphology dataset for Korean that preserves its distinct characteristics. |
| Outcome: | The proposed dataset extracts inflected Korean verb forms from the largest annotated corpus for Korean. |
Bernice: A Multilingual Pre-trained Encoder for Twitter (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing language models for Twitter are monolingual, adapted from other domains, or trained on limited amount of in-domain data. |
| Approach: | They propose a multilingual RoBERTa language model that is trained from scratch on 2.5 billion tweets with a custom tweet-focused tokenizer. |
| Outcome: | The proposed model outperforms or matches models trained on monolingual and multilingual tweets on a variety of benchmarks and is more efficient compute- and data-wise to train completely on in-domain data with a specialized domain-specific tokenizer. |
The Language of Legal and Illegal Activity on the Darknet (P19-1)
Copied to clipboard
| Challenge: | a study of the characteristics of text in the Darknet shows that it has legal and illegal content. |
| Approach: | They compare texts for selling legal and illegal drugs to a control condition . they find several distinguishing features between legal and illicit texts . |
| Outcome: | The authors compare legal and illegal texts to a clear net website with similar content as a control condition. |
Convergence and Diversity in the Control Hierarchy (2023.acl-long)
Copied to clipboard
| Challenge: | Weir has defined a hierarchy of language classes whose second member (L2) is generated by tree-adjoining grammars (TAG), linear indexed grammars, combinatory categorial grammars and head grammars. |
| Approach: | They propose to extend Weir's mechanism of control to give a definition of controllable pushdown automata (PDAs) they propose to use a stricter notion of equivalence to allow for finer-grained comparisons than weak equvalence. |
| Outcome: | The proposed language classes are d-weakly equivalent to Weir's original two-level grammar, but not d strongly equivalent. |
Lexically Grounded Subword Segmentation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Statistical word segmentation algorithms have remained a thorn in the side of many researchers. |
| Approach: | They propose to use unsupervised morphological analysis with Morfessor as pre-tokenization and an algebraic method for obtaining subword embeddings grounded in a word embeddable space. |
| Outcome: | The proposed methods improve morphological plausibility and Rényi efficiency on part-of-speech tagging and machine translation tasks. |
Document Segmentation Matters for Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
Zhitong Wang, Cheng Gao, Chaojun Xiao, Yufei Huang, Shuzheng Si, Kangyang Luo, Yuzhuo Bai, Wenhao Li, Tangjian Duan, Chuancheng Lv, Guoshan Lu, Gang Chen, Fanchao Qi, Maosong Sun
| Challenge: | Existing rule-based chunking methods lead to suboptimal splits, where overly large chunks introduce irrelevant information and small chunks lack semantic coherence. |
| Approach: | They propose a method that leverages document summaries as pseudo-instructions to guide chunking by computing semantic similarity between sentences and the summary. |
| Outcome: | Experiments on multiple open-domain question-answering benchmarks show that PIC significantly improves retrieval accuracy (Hits@k) and end-to-end QA performance (Exact Match) without any additional training. |
Climbing the Tower of Treebanks: Improving Low-Resource Dependency Parsing via Hierarchical Source Selection (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent work on multilingual dependency parsing focused on developing highly multilingual parsers . a recent major paradigm shift in NLP towards largescale pretrained language models has reduced the downstream relevance of supervised syntactic parse. |
| Approach: | They propose a heuristic approach to multilingual dependency parsing that heurs out the "one model to rule them all" approach by hierarchically clustering all Universal Dependencies languages based on their syntactic similarity . |
| Outcome: | The proposed approach outperforms a "one model to rule them all" approach with a heuristic selection of languages and treebanks for a target language. |
Multilingual Nonce Dependency Treebanks: Understanding how Language Models Represent and Process Syntactic Structure (2024.naacl-long)
Copied to clipboard
| Challenge: | a number of studies have focused on making explicit the linguistic information encoded in language models (LMs) however, this method has been criticized for various reasons. |
| Approach: | They introduce a framework for creating nonce treebanks for multilingual UD corpora . they investigate word co-occurrence statistics and show how nonce data affects the performance of syntactic dependency probes. |
| Outcome: | The proposed framework satisfies syntactic argument structure and ensures grammaticality via language-specific rules. |
Universal Semantic Tagging for English and Mandarin Chinese (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to generating semantic annotations for different languages are attracting more and more interest. |
| Approach: | They propose to extend Universal Semantic Tagging to Mandarin Chinese and evaluate its performance. |
| Outcome: | The proposed scheme is only tested in four Indo–European languages . accuracies are 92.7% and 94.6% for Chinese and English respectively . |
Comparing LLM-generated and human-authored news text using formal syntactic theory (2025.acl-long)
Copied to clipboard
| Challenge: | a systematic comparison of LLM-generated and human-authored texts is a topic of growing interest in the field of natural language processing. |
| Approach: | They compare LLM-generated and human-authored New York Times texts using a formal syntactic theory . they use a broad-coverage English resource grammar to analyze the texts . |
| Outcome: | The proposed comparisons reveal systematic differences between human and LLM-generated texts . the authors hope the results will lead to further discoveries about grammatical properties of LLMs . |
An In-depth Study on Internal Structure of Chinese Words (2021.acl-long)
Copied to clipboard
Chen Gong, Saihao Huang, Houquan Zhou, Zhenghua Li, Min Zhang, Zhefeng Wang, Baoxing Huai, Nicholas Jing Yuan
| Challenge: | Unlike English letters, Chinese characters have rich and specific meanings. |
| Approach: | They propose to model Chinese words' internal structures as dependency trees with 11 labels for distinguishing syntactic relationships. |
| Outcome: | The proposed model of Chinese word-internal structures shows it can be used to parse sentences . it shows that the model can be applied to a sentence-level task with a competitive dependency parser. |
A Web Service for Pre-segmenting Very Long Transcribed Speech Recordings (L18-1)
Copied to clipboard
| Challenge: | a new algorithm that pre-segments long speech recordings into manageable chunks is proposed . the run time of classical text-to-speech alignment algorithms is quadratically growing with the length of the input . |
| Approach: | They propose two algorithms that pre-segment long speech recordings into manageable chunks . first algorithm is fast but cannot guarantee short chunks on noisy recordings or erroneous transcriptions a second algorithm delivers short chunk but is less effective in terms of run time and chunk boundary accuracy . |
| Outcome: | The proposed algorithms reduce the run time of the speech segmentation system to under real-time even on recordings that could not previously be processed. |
Semantic Dependency Parsing with Edge GNNs (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing semantic dependency parsers use factor graphs to generate a tree structure, but they are ill-suited for a more complex semantic relationship representation. |
| Approach: | They propose a second-order neural CRF parser that uses factor graphs to generate a dependency edge and define neighbors in terms of sibling, co-parent, and grandparent relationships. |
| Outcome: | The proposed model outperforms the first-order biaffine parser on English datasets and shows that it is more efficient than the first order. |
Language-Independent Approach for Morphological Disambiguation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches for predicting complex morphological tags treat each analysis as a tag and apply sequence labeling models to perform tagging. |
| Approach: | They propose a language-independent approach which integrates all words, roots, POS and morpheme tags into vectors and computes the inner products between analyses and the contexts. |
| Outcome: | The proposed approach outperforms existing models on seven different languages while running about 6 and 33 times faster than MarMot and Seq2Seq, respectively. |
Grapheme-level Awareness in Word Embeddings for Morphologically Rich Languages (L18-1)
Copied to clipboard
| Challenge: | a study of inflectional and non-alphabetic languages shows word vectors are sparse in data sparsity due to the morphological system of a language and its syllables. |
| Approach: | They propose a grapheme-level coding procedure for neural word embedding that uses syllable characters to represent word-internal features. |
| Outcome: | The proposed model is more capable of representing functional and semantic similarities than syllable-level and word-level models. |
Building a Constraint Grammar Parser for Plains Cree Verbs and Arguments (L18-1)
Copied to clipboard
| Challenge: | a Constraint Grammar parser for Plains Cree is developed for its rich morphology and syntax . the focus of the parsers is to identify relationships between verbs and arguments . |
| Approach: | This paper presents the development and application of a Constraint Grammar parser for Plains Cree . the parsers focus on the identification of relationships between verbs and arguments . |
| Outcome: | The proposed parser is based on a Constraint Grammar formalism for the Plains Cree language . it allows for the identification of common word order patterns and relationships between word order and information structure . |
An Enhanced Mapping Scheme of the Universal Part-Of-Speech for Korean (2020.lrec-1)
Copied to clipboard
| Challenge: | When mapping a language specific Part-Of-Speech (POS) tag set to the Universal POS tag set (UPOS), it is critical to consider the individual language’s linguistic features and the UPOS definitions. |
| Approach: | They propose to map a Korean Part-Of-Speech (POS) tag set to the Universal POS tag set (UPOS) using a morpheme-based mapping. |
| Outcome: | The proposed mappings are based on the Korean linguistic typology and the substantive definitions of the UPOS categories. |
String Editing Based Chinese Grammatical Error Diagnosis (2022.coling-1)
Copied to clipboard
| Challenge: | Chinese Grammatical Error Diagnosis (CGED) suffers from numerous types of grammatical errors and insufficiency of training data. |
| Approach: | They propose a string editing based CGED model that uses a unified workflow to handle various types of grammatical errors. |
| Outcome: | The proposed model outperforms existing models on Chinese datasets in many aspects. |
Argumentation Mining on Essays at Multi Scales (2020.coling-main)
Copied to clipboard
| Challenge: | Argumentation mining on essays is a new task in natural language processing. |
| Approach: | They propose a multi-scale argumentation mining model which aims to identify the types and locations of argumentation components from essay text. |
| Outcome: | The proposed model outperforms existing models on mining all types of argumentation components on the Persuasive Essay dataset. |
Soft Syntactic Reinforcement for Neural Event Extraction (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent event extraction methods rely on pre-trained language models but still suffer from errors due to a lack of syntactic knowledge. |
| Approach: | They propose a method to incorporate syntactic information into PLM-based models for event extraction (EE) this method uses a standard dependency corpus to select syntax-related dimensions of the model's representation. |
| Outcome: | The proposed method outperforms baseline models and existing syntactic reinforcement methods on sentence-level and document-level EE benchmark datasets. |
Position Offset Label Prediction for Grammatical Error Correction (2022.coling-1)
Copied to clipboard
| Challenge: | Experimental results show that our proposed POL-Pc framework improves baseline models and yields consistent performance gain over various data augmentation methods. |
| Approach: | They propose a position offset label prediction subtask to integrate correction editing operations into a unified framework. |
| Outcome: | The proposed model outperforms baseline models on Chinese, English and Japanese datasets by a wide margin. |
DerivBase.Ru: a Derivational Morphology Resource for Russian (2020.lrec-1)
Copied to clipboard
| Challenge: | DerivBase.Ru is a high-coverage derivational morphology resource for Russian language that can be used for many tasks such as paraphrases and plagiarism detection. |
| Approach: | They propose a rule-based framework for deriving Russian words using a derivational morphology resource called DerivBase.Ru. |
| Outcome: | The proposed framework can be used to derivate words from a dictionary in Russian and German. |
Morfessor EM+Prune: Improved Subword Segmentation with Expectation Maximization and Pruning (2020.lrec-1)
Copied to clipboard
| Challenge: | Subword segmentation is a standard preprocessing step in many neural approaches to natural language processing. |
| Approach: | They propose to train a unigram subword model using a recursive algorithm and lexicon pruning algorithm. |
| Outcome: | The proposed method improves on the original training algorithm and improves morphological segmentation accuracy. |
Weakly Supervised Headline Dependency Parsing (2022.findings-emnlp)
Copied to clipboard
| Challenge: | English news headlines have unique syntactic properties documented in linguistics literature since the 1930s. |
| Approach: | They propose to provide the first news headline corpus of annotated syntactic dependency trees to evaluate existing NLP parsers on news headlines. |
| Outcome: | The proposed method improves performance across different news outlets, but is moderated by constructions idiosyncratic to outlet. |
On Tree-Based Neural Sentence Modeling (D18-1)
Copied to clipboard
| Challenge: | Existing tree-based sentence modeling approaches adopt syntactic parsing trees as the explicit structure prior. |
| Approach: | They replace parsing trees with trivial trees to study their effectiveness . they found that tree-based sentence modeling gives better results when crucial words are closer to the final representation . |
| Outcome: | The proposed tree-based sentences have shown better results on many downstream tasks. |
Finding Universal Grammatical Relations in Multilingual BERT (2020.acl-main)
Copied to clipboard
| Challenge: | Recent work has found that multilingual masked language models learn a surprising amount of linguistic structure, despite a lack of direct linguistic supervision. |
| Approach: | They propose an unsupervised method to find syntactic tree distances in languages other than English and that these subspaces are approximately shared across languages. |
| Outcome: | The proposed method shows that mBERT learns representations of syntactic dependency labels, in the form of clusters, which largely agree with the Universal Dependencies taxonomy. |
How Universal are Universal Dependencies? Exploiting Syntax for Multilingual Clause-level Sentiment Detection (2020.lrec-1)
Copied to clipboard
| Challenge: | a new method for clause-level sentiment detection is proposed for multilingual use cases. |
| Approach: | They propose a pipeline method that makes the most of syntactic structures based on Universal Dependencies. |
| Outcome: | The proposed method achieves high precision in sentiment detection for 17 languages . it avoids machine-learning approaches that may cause obstacles to its use cases . |
Lexicosyntactic Inference in Neural Models (D18-1)
Copied to clipboard
| Challenge: | lexicosyntactic inferences are triggered by surprising aspects of the syntactical context that a word occurs in. |
| Approach: | They build a factuality judgment dataset for English clause-embedding verbs in various syntactic contexts and use it to probe the behavior of current state-of-the-art neural systems. |
| Outcome: | The proposed model makes systematic errors that are visible through the lens of factuality prediction. |
EXPRES Corpus for A Field-specific Automated Exploratory Study of L2 English Expert Scientific Writing (2022.lrec-1)
Copied to clipboard
| Challenge: | Developing proficient writing skills in English is a debated topic since the 1990s . RAs are an academic genre that hold a central place in academia . |
| Approach: | They propose to use a linguistic assessment model to assess the linguistic profile of research articles written in L2 English. |
| Outcome: | The proposed model can help scholars adapt to the writing norms of their communities of practice. |
Analysis of GlobalPhone and Ethiopian Languages Speech Corpora for Multilingual ASR (2020.lrec-1)
Copied to clipboard
| Challenge: | Using global phone data, we can develop multilingual speech recognition systems in yet unsupported languages. |
| Approach: | They analyze phonetic overlaps between GlobalPhone and Ethiopian speech corpora to develop multilingual Automatic Speech Recognition system for the Ethiopian languages. |
| Outcome: | The proposed system will be able to support three different languages and have morphological complexity. |
Enhancing Automatic Term Extraction with Large Language Models via Syntactic Retrieval (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have improved IE, but their potential for ATE has not been explored. |
| Approach: | They propose a retrieval-based prompting strategy that selects demonstrations according to syntactic rather than semantic similarity in a few-shot setting. |
| Outcome: | The proposed method improves performance on three specialized ATE benchmarks. |
What can we learn from Semantic Tagging? (D18-1)
Copied to clipboard
| Challenge: | a recent study shows that multi-task learning improves performance of NLP tasks by exploiting similarities between tasks. |
| Approach: | They employ semantic tagging as an auxiliary task for three NLP tasks . they compare full neural network sharing, partial neural network shared and learning what to share . |
| Outcome: | The proposed model improves for part-of-speech tagging, universal dependency parsing and natural language inference. |
How to Best Use Syntax in Semantic Role Labelling (P19-1)
Copied to clipboard
| Challenge: | Existing studies on integrating external information into NLP tasks focus on word-level shallow features such as POS or chunk tags. |
| Approach: | They propose to integrate syntactic information into a neural ELMo-based SRL sequence labelling model by using a constituency representation as input features. |
| Outcome: | The proposed approach improves performance on the in-domain CoNLL’05 and CoNll’12 benchmarks. |
Is the Brain Mechanism for Hierarchical Structure Building Universal Across Languages? An fMRI Study of Chinese and English (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have shown that the brain builds hierarchical syntactic structures, but it is unknown whether they are universal across languages. |
| Approach: | They analyze the working memory requirements when applying parsing strategies to two languages: Chinese and English. |
| Outcome: | The proposed method shows that the brain adopts parsing strategies with less memory load according to different language structures. |
A Learning-Based Dependency to Constituency Conversion Algorithm for the Turkish Language (2022.lrec-1)
Copied to clipboard
Büşra Marşan, Oğuz K. Yıldız, Aslı Kuzgun, Neslihan Cesur, Arife B. Yenice, Ezgi Sanıyar, Oğuzhan Kuyrukçu, Bilge N. Arıcan, Olcay Taner Yıldız
| Challenge: | a team of linguists manually annotated a set of constituency trees. |
| Approach: | They propose to create the first Turkish-based dependency-to-constituency conversion algorithm using a morphologic analyser and feature-based machine learning model. |
| Outcome: | The proposed algorithm can be used to generate new constituency treebanks and training data for NLP resources like constituency parsers. |
Data Augmentation via Dependency Tree Morphing for Low-Resource Languages (D18-1)
Copied to clipboard
| Challenge: | Lack of sizable training datasets leads to poor performance in low-resource languages. |
| Approach: | They propose two techniques to augment training sets of low-resource languages using dependency trees. |
| Outcome: | The proposed methods improve on the training datasets for low-resource languages. |
A Free/Open-Source Morphological Analyser and Generator for Sakha (2022.lrec-1)
Copied to clipboard
| Challenge: | a morphological transducer for Sakha is being developed for use in downstream tasks . the marginalised language is subject to increasing economic and cultural peril due to climate change . |
| Approach: | They describe the development of a morphological analyser and generator for Sakha . the transducer has coverage of solidly above 90%, and high precision . it is already being used in downstream tasks such as linguistic maintenance . |
| Outcome: | The proposed morphological analyser has coverage of 90% and high precision . it is already being used in computer assisted language learning applications . |
An Expanded Finite-State Transducer for Tsuut’ina Verbs (2022.lrec-1)
Copied to clipboard
| Challenge: | a finite state transducer (FST) for the transitive verb system of Tsuut'ina (ISO 639-3: srs) is described for the Dene (Athabaskan) language spoken in Alberta, Canada. |
| Approach: | They describe the expansion of a finite state transducer (FST) for the transitive verb system of Tsuut'ina (ISO 639-3: srs) Dene languages have unique templatic morphology, in which lexical, inflectional and derivational tiers are interlaced. |
| Outcome: | The proposed model can handle a great range of common and rare argument structure types, including ditransitive and uniquely Dene object experiencer verbs. |
Exploring Linguistic Probes for Morphological Inflection (2023.emnlp-main)
Copied to clipboard
| Challenge: | morphological inflection models typically employ language-independent data splitting algorithms. |
| Approach: | They propose language-specific probes to test aspects of morphological generalization . they use three morphology-distinct languages to test their generalization abilities . |
| Outcome: | The proposed language-specific probes are used to test morphological generalization abilities on three distinct languages. |
Transition-based Bubble Parsing: Improvements on Coordination Structure Prediction (2021.acl-long)
Copied to clipboard
| Challenge: | Existing bubble representations encoding coordination boundaries and internal relationships are difficult to detect and parse . |
| Approach: | They propose a bubble parser to perform coordination structure identification and dependency-based syntactic analysis simultaneously. |
| Outcome: | The proposed bubble parser beats state-of-the-art approaches on coordination structure prediction . the proposed system is based on a GENIA corpus and a Penn treebank . |
Chinese Couplet Generation with Syntactic Information (2022.coling-1)
Copied to clipboard
| Challenge: | Chinese couplet generation aims to generate a pair of clauses with certain rules adhered . previous studies have focused on learning the correspondences between antecedent and subsequent clauses . |
| Approach: | They propose to leverage syntactic information to generate Chinese couplets by POS tags and word dependencies. |
| Outcome: | The proposed approach outperforms baselines on a Chinese couplet generation dataset. |
Development of a Multilingual CCG Treebank via Universal Dependencies Conversion (2022.lrec-1)
Copied to clipboard
| Challenge: | Combinatory Categorial Grammar (CCG) is a lexicalized grammar formalism that can capture both syntactic and semantic information. |
| Approach: | They propose an algorithm to convert UD treebanks to CCG treebank and propose future extensions. |
| Outcome: | The proposed algorithm performs lexical, sentential, and syntactic rule coverage analysis, as well as CCG parsing experiments. |
Singlish Where Got Rules One? Constructing a Computational Grammar for Singlish (2022.lrec-1)
Copied to clipboard
| Challenge: | Singlish is a variety of English spoken in Singapore and has many non-standard features. |
| Approach: | They propose to use Singlish as a branch of English grammar to implement new rules and add new lexical types to it. |
| Outcome: | The proposed grammar is based on the existing rules and lexical types from the English resource grammar and compared with the standard English grammar. |
Incorporating Contextual Information for Language-Independent, Dynamic Disambiguation Tasks (L18-1)
Copied to clipboard
| Challenge: | a proposed multimodal system can resolve syntactic ambiguities by exploiting external evidence, says a researcher . a parser that processes linguistic information is expected to handle syntakically unambiguous sentences, but it cannot. |
| Approach: | They propose to exploit external contextual information to resolve ambiguous sentences . they propose to use data-driven and grammar-based approaches to solve ambiguities . |
| Outcome: | The proposed system confirms this hypothesis in experiments on syntactically ambiguous sentences. |
Establishing a New State-of-the-Art for French Named Entity Recognition (2020.lrec-1)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a task consisting in identifying text spans that denote named entities such as person, location and organization names. |
| Approach: | They manually annotated the French TreeBank with information related to named entities . they sketch the underlying annotation guidelines and provide a few figures about the annotations . |
| Outcome: | The French TreeBank is the main source of morphosyntactic and syntactical annotations for French. |
Comparison of Pun Detection Methods Using Japanese Pun Corpus (L18-1)
Copied to clipboard
| Challenge: | A sampling survey of typology and component ratio analysis in Japanese puns revealed that the type of Japanese pun that had the largest proportion was a pun type with two sound sequences. |
| Approach: | They propose a method to detect phonetically similar Japanese puns using phonological similarity and insertion / omission of prolonged sounds in addition to lexical feature. |
| Outcome: | The proposed method is validated by adding the rule-based features to the baseline. |
Generalizing over Long Tail Concepts for Medical Term Normalization (2022.emnlp-main)
Copied to clipboard
Beatrice Portelli, Simone Scaboro, Enrico Santus, Hooman Sedghamiz, Emmanuele Chersoni, Giuseppe Serra
| Challenge: | Medical term normalization is a task of mapping a text to a large number of output classes. |
| Approach: | They propose a learning strategy that leverages hierarchical information to enhance generalizability of models. |
| Outcome: | The proposed strategy produces state-of-the-art performance on seen concepts and consistent improvements on unseen ones, allowing efficient zero-shot knowledge transfer across text typologies and datasets. |
Construction of a Quality Estimation Dataset for Automatic Evaluation of Japanese Grammatical Error Correction (2022.lrec-1)
Copied to clipboard
Daisuke Suzuki, Yujin Takahashi, Ikumi Yamashita, Taichi Aida, Tosho Hirasawa, Michitaka Nakatsuji, Masato Mita, Mamoru Komachi
| Challenge: | Existing studies on automatic evaluation of grammatical error correction (GEC) have shown that quality estimation models built from manual evaluation can achieve high performance in automatic evaluation in English. |
| Approach: | They used a dataset with manual evaluation to build an automatic evaluation model for Japanese GEC. |
| Outcome: | The proposed model is based on a Japanese dataset with manual evaluation and meta-evaluation. |
Generating Sentences from Disentangled Syntactic and Semantic Spaces (P19-1)
Copied to clipboard
| Challenge: | Variational auto-encoders (VAEs) are widely used in natural language generation due to the regularization of the latent space. |
| Approach: | They propose to generate sentences from disentangled syntactic and semantic spaces by using the linearized tree sequence. |
| Outcome: | The proposed method achieves similar or better performance in various tasks compared with state-of-the-art models. |
Universal Grammatical Dependencies for Portuguese with CINTIL Data, LX Processing and CLARIN support (2022.lrec-1)
Copied to clipboard
| Challenge: | a new collection of quality language resources is presented for the computational processing of the Portuguese language . the framework for the mapping between linguistic form and meaning is centered on the notion of grammatical relation . |
| Approach: | They propose a new set of quality language resources for the computational processing of the Portuguese language under the Universal Dependencies framework. |
| Outcome: | The proposed framework provides for the mapping between linguistic form and meaning representations. |
MEGA RST Discourse Treebanks with Structure and Nuclearity from Scalable Distant Sentiment Supervision (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing discourse treebanks are limited in the application of data-driven approaches to discourse parsing. |
| Approach: | They propose a method to automatically generate discourse treebanks using distant supervision from sentiment annotated datasets by heuristic beam-search strategy extended with a stochastic component. |
| Outcome: | The proposed method generates discourse trees incorporating structure and nuclearity for documents of arbitrary length using an efficient beam-search strategy, extended with a stochastic component. |
CoNLL-UL: Universal Morphological Lattices for Universal Dependency Parsing (L18-1)
Copied to clipboard
Amir More, Özlem Çetinoğlu, Çağrı Çöltekin, Nizar Habash, Benoît Sagot, Djamé Seddah, Dima Taji, Reut Tsarfaty
| Challenge: | Using the universal dependencies framework, we address the need for a universal representation of morphological analysis that can capture alternative morphology of surface tokens and is compatible with the segmentation and morphologic annotation guidelines prescribed for UD treebanks. |
| Approach: | They propose a new annotation format for word lattices that represent morphological analyses and a resource that obeys this format for a range of typologically different languages. |
| Outcome: | The proposed model can capture alternative morphological analyses of surface tokens and is compatible with the segmentation and morphology guidelines prescribed for UD treebanks. |
Part-of-Speech Tagging for Arabic Gulf Dialect Using Bi-LSTM (L18-1)
Copied to clipboard
| Challenge: | Part-of-speech (POS) tagging is one of the most important building blocks in many natural language processing (NLP) applications. |
| Approach: | They propose to use a POS tagger for Arabic Gulf dialect to improve POS tagging accuracy. |
| Outcome: | The proposed POS tagger improves POS tagging accuracy for the Arabic Gulf dialect from 75% accuracy to 91% accuracy using a bi-LSTM labeler. |
Transition-based Semantic Dependency Parsing with Pointer Networks (2020.acl-main)
Copied to clipboard
| Challenge: | Existing dependency parsers cannot be directly applied, so they need to be adaptable to deal with the absence of singlehead and connectedness constraints. |
| Approach: | They propose a transition system that produces labelled directed acyclic graphs and performs semantic dependency parsing with Pointer Networks. |
| Outcome: | The proposed system outperforms graph-based models and outperformed existing models on a harder NLP problem. |
NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Texts (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent studies on Chinese grammatical error correction focus on learning essays. |
| Approach: | They propose a Chinese grammatical error correction dataset that annotates multiple references for 12,500 sentences from three native domains. |
| Outcome: | The proposed dataset can be used to facilitate research on Chinese grammatical error correction (CGEC) for native speaker texts from multiple domains. |
Constraint-based Learning of Phonological Processes (D19-1)
Copied to clipboard
| Challenge: | Phonological processes govern the way speech sounds in natural languages change depending on context . a novel approach to learning phonological processes from related utterances is proposed . |
| Approach: | They propose an unsupervised approach to learning phonological processes from related utterances . they encode the problem into Boolean constraints that enable data efficiency and fast inference . |
| Outcome: | The proposed approach achieves high accuracy at interactive speeds on phonology problems and datasets. |
Dependency Parsing for Urdu: Resources, Conversions and Learning (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing treebanks for Urdu are under-resourced due to lack of resources. |
| Approach: | They propose to convert existing treebanks into a common format that is based on Universal Dependencies. |
| Outcome: | The proposed format outperforms the MaltParser and a transition-based BiLSTM parser with word embeddings and significantly improves parsing accuracy. |
Training a Swedish Constituency Parser on Six Incompatible Treebanks (2020.lrec-1)
Copied to clipboard
| Challenge: | Syntactic parsing is a widely used intermediate step in several natural language processing tasks. |
| Approach: | They propose to use a function-tagged constituent treebank for Swedish which includes discontinuous constituents to improve the accuracy. |
| Outcome: | The proposed parser can be trained on additional treebanks that use other annotation models. |
The Use of Text Alignment in Semi-Automatic Error Analysis: Use Case in the Development of the Corpus of the Latvian Language Learners (L18-1)
Copied to clipboard
| Challenge: | Using error annotation methods, the corpus of the Latvian language learners can be adapted for other languages with relatively free word order. |
| Approach: | They propose a method for creating error annotated corpora using text correction, automated morphological analysis, automated text alignment and error annotation. |
| Outcome: | The proposed method has been approbated in the development of the corpus of the Latvian language learners. |
Predicting the Growth of Morphological Families from Social and Linguistic Factors (2020.acl-main)
Copied to clipboard
| Challenge: | a burst in token frequency of the word "trump" in social media before the 2016 presidential election is a prime indicator of topical dynamics. |
| Approach: | They propose a task of Morphological Family Expansion Prediction to predict the size of a morphological family by analyzing a reddit corpus. |
| Outcome: | The proposed task predicts the increase in the size of a morphological family on a reddit corpus. |
Recognizing Sentence-level Logical Document Structures with the Help of Context-free Grammars (2020.lrec-1)
Copied to clipboard
| Challenge: | Current sentence boundary detectors split documents into sequentially ordered sentences without their dependencies. |
| Approach: | They propose a tool that segments sentences into tree structures to detect recursive structure . they retrain different constituency parsers to transform them into sentence segmenters . |
| Outcome: | The proposed tool can detect recursive structure in documents with a main clause and subordinate clauses . the proposed tool improves German dependency parsing by providing additional structural information. |
Towards the Conversion of National Corpus of Polish to Universal Dependencies (2020.lrec-1)
Copied to clipboard
| Challenge: | a paper aims at enriching the manually annotated part of National Corpus of Polish with a syntactic layer. |
| Approach: | They enrich manually annotated part of Polish National Corpus with a syntactic layer and a UD dependency graph. |
| Outcome: | The proposed model outperforms a model trained on a smaller set of gold-standard trees in predicting part-of-speech tags, morphological features, lemmata and labelled dependency trees. |
A Tale of a Probe and a Parser (2020.acl-main)
Copied to clipboard
| Challenge: | researchers train supervised models to extract linguistic structure from output of another model . supervised model can be used to perform tasks such as part-of-speech tags or dependency trees . |
| Approach: | They compare a structural probe to a more traditional parser with a lightweight parameterisation. |
| Outcome: | The structural probe outperforms a traditional parser on seven of nine languages . the researchers found that the model outperformed the parsers by 11.1 points . |
Dependency Graph Parsing as Sequence Labeling (2024.emnlp-main)
Copied to clipboard
| Challenge: | Various linearizations have been proposed to cast syntactic dependency parsing as sequence labeling, but they cannot handle reentrancy or cycles. |
| Approach: | They propose unbounded linearizations that can be used to cast dependency parsing as sequence labeling. |
| Outcome: | The proposed linearizations can cast syntactic dependency parsing as a sequence labeling task. |
From SPMRL to NMRL: What Did We Learn (and Unlearn) in a Decade of Parsing Morphologically-Rich Languages (MRLs)? (2020.acl-main)
Copied to clipboard
| Challenge: | a decade has passed since the establishment of SPMRL to address the peculiar challenges of Statistical Parsing for Morphologically-rich languages (MRLs). |
| Approach: | They propose a framework for parsing MRLs and propose implementing symbolic ideas into modern neural architectures. |
| Outcome: | The proposed strategies are based on the multi-tagging task in Hebrew, a morphologically-rich, high-fusion, language. |
Chapter Captor: Text Segmentation in Novels (2020.emnlp-main)
Copied to clipboard
| Challenge: | Using a hybrid approach, we identify chapter boundaries in novels . chapter boundaries are typically denoted by formatting conventions such as page breaks, white-space, chapter numbers, and titles. |
| Approach: | They build a project Gutenberg data set of 9,126 English novels to analyze chapter boundaries . they use neural inference and rule matching to recognize chapter title headers . |
| Outcome: | The proposed method achieves an F1 score of 0.77 on the segmentation task . the annotated data reveal interesting historical trends in the chapter structure of novels . |
Grammatical Error Correction in Low Error Density Domains: A New Benchmark and Analyses (2020.emnlp-main)
Copied to clipboard
| Challenge: | CWEB is a new benchmark for grammatical error correction (GEC) systems . website data contains far fewer grammamatical errors than learner essays . |
| Approach: | They propose to broaden the target domain of grammatical error correction (GEC) systems . website data contains far fewer grammamatical errors than learner essays . |
| Outcome: | The proposed model can't rely on a strong internal language model in low error density domains. |
Reproducing a Morphosyntactic Tagger with a Meta-BiLSTM Model over Context Sensitive Token Encodings (2020.lrec-1)
Copied to clipboard
| Challenge: | Reproducibility of research results is only recently beginning to be practiced and acknowledged . a research culture that focuses on beating previous benchmarks while disregarding the need to contribute to scientific knowledge and understanding is a problem, says a researcher. |
| Approach: | They reproduced work on morphosyntactic tagging using a meta-model . they did not contact the original authors for reproduction . |
| Outcome: | The proposed model outperforms previous models on morphological tagging tasks but fails to match the F1-scores reported for the meta-BiLSTM model. |
Extrinsic Evaluation of French Dependency Parsers on a Specialized Corpus: Comparison of Distributional Thesauri (2020.lrec-1)
Copied to clipboard
| Challenge: | Using a frequency-based method, we can identify subsets of the same word contexts without any reference data. |
| Approach: | They compare 11 different French dependency parsers on a specialized corpus to generate distributional thesauri using a frequency-based method. |
| Outcome: | The proposed method can identify relevant subsets without reference data and the similarity is confirmed on a restricted distributional benchmark. |
PortiLexicon-UD: a Portuguese Lexical Resource according to Universal Dependencies Model (2022.lrec-1)
Copied to clipboard
| Challenge: | lexical resource for Brazilian Portuguese with 1,221,218 entries, according to the Universal Dependencies model and guidelines. |
| Approach: | They propose to build a large and freely available lexicon for Portuguese that delivers morphosyntactic information according to the Universal Dependencies model. |
| Outcome: | The proposed lexical resource has high language coverage and good quality data. |
From English to Code-Switching: Transfer Learning with Strong Morphological Clues (2020.acl-main)
Copied to clipboard
| Challenge: | Linguistic code-switching (CS) is an understudied area in natural language processing . lack of resources and annotated data makes it difficult to strive for progress in CS-related tasks. |
| Approach: | They propose a method to adapt monolingual models to code-switched text in various tasks . they transfer English knowledge from a pre-trained ELMo model to different code-paired languages . |
| Outcome: | The proposed method outperforms multilingual BERT and homologous CS-unaware models and provides state-of-the-art in CS tasks. |
FreeChunker: A Cross-Granularity Chunking Framework (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing chunking paradigms rely on static boundary identification, limiting performance . Existing methods rely only on static knowledge, resulting in hallucinated content . |
| Approach: | They propose a Cross-Granularity Encoding Framework that treats sentences as atomic units and shifts from static chunk segmentation to flexible retrieval supporting arbitrary sentence combinations. |
| Outcome: | The proposed framework avoids the computational overhead required for semantic boundary detection and enhances adaptability to complex queries. |
Frugal Paradigm Completion (2020.acl-main)
Copied to clipboard
| Challenge: | Lexica distinguishing all morphologically related forms of each lexeme is crucial to many language technologies, yet building them is expensive. |
| Approach: | They propose a paradigm completion approach that predicts all related forms from as few manually provided forms as possible. |
| Outcome: | The proposed method reduces manual labor by 16-63% and is the most robust to typological variation. |
Improving Chinese Word Segmentation with Wordhood Memory Networks (2020.acl-main)
Copied to clipboard
| Challenge: | Contextual features are important in Chinese word segmentation (CWS) but it is difficult to integrate wordhood information into existing neural models. |
| Approach: | They propose a neural framework that integrates contextual wordhood information with several popular encoder-decoder combinations for Chinese word segmentation. |
| Outcome: | The proposed framework achieves state-of-the-art performance on five benchmark datasets. |
Joint Diacritization, Lemmatization, Normalization, and Fine-Grained Morphological Tagging (2020.acl-main)
Copied to clipboard
| Challenge: | a word can have multiple interpretations and is one of many inflected forms of the same concept or lemma. |
| Approach: | They propose to model morphological features jointly, whether lexicalized or non-lexicalised . their results are compared to Arabic and Egyptian Arabic . |
| Outcome: | The proposed model achieves 20% relative error reduction in Arabic and 11% in Egyptian Arabic. |
Words, Subwords, and Morphemes: What Really Matters in the Surprisal-Reading Time Relationship? (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies using LLMs on psycholinguistic data have gone unverified . a growing body of research is using word-level prediction as a computational proxy . |
| Approach: | They compare morphological, morphologic, and BPE tokenization estimates with reading time data. |
| Outcome: | The proposed method could be used to evaluate morphological prediction. |
Diversifying language models for lesser-studied languages and language-usage contexts: A case of second language Korean (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing morpheme parsers/taggers do not work reliably and optimally for L2 data. |
| Approach: | They train a neural network model on varying L2 datasets and measure its morpheme parsing/POS tagging performance on L2 test sets. |
| Outcome: | The proposed model excels in domain-specific tokenization and POS tagging compared to the baseline model. |
Annotating the Tweebank Corpus on Named Entity Recognition and Building NLP Models for Social Media Analysis (2022.lrec-1)
Copied to clipboard
| Challenge: | Social media data such as Twitter messages pose a particular challenge to NLP systems because of their short, noisy nature. |
| Approach: | They create a Twitter-based NER corpus and train Tweet NLP models on it . they annotate named entities in TB2 using Amazon Mechanical Turk . |
| Outcome: | The proposed model outperforms existing models on Twitter and other social media platforms. |
System Combination via Quality Estimation for Grammatical Error Correction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing quality estimation models are not good enough to distinguish good corrections from bad ones, resulting in low F0.5 scores when used for system combination. |
| Approach: | They propose a new quality estimation model that gives a better estimate of the quality of a corrected sentence. |
| Outcome: | The proposed model outperforms the state-of-the-art on the CoNLL-2014 and BEA-2019 test sets, and achieves the highest F0.5 scores published to date. |
Incorporating Word-level Phonemic Decoding into Readability Assessment (2024.lrec-main)
Copied to clipboard
| Challenge: | a recent study suggests that automatic readability assessment is not able to provide interpretability for teachers and educators. |
| Approach: | They propose to incorporate phonetic and orthographic features into automatic readability assessment by handcrafted feature sets. |
| Outcome: | a new feature set shows comparable performance to larger feature sets on grade-level classification in english . authors say the model improves on multiple readability datasets but lacks interpretability . |
An Information-Theoretic Characterization of Morphological Fusion (2021.emnlp-main)
Copied to clipboard
| Challenge: | Linguistic typology generally divides synthetic languages into groups based on their morphological fusion. |
| Approach: | They propose to quantify the degree of fusion of morphological features in a surface form . they recapitulate the usual linguistic classifications for concatenative systems . |
| Outcome: | The proposed measure recapitulates the usual classifications for concatenative systems and provides new measures for nonconcatenating ones. |
Transcribing Vocal Communications of Domestic Shiba lnu Dogs (2023.findings-acl)
Copied to clipboard
| Challenge: | a recent study has focused on how animals communicate, but the study has been limited . previous studies have focused on a simple classification problem, requiring a model to get a label . |
| Approach: | They extract Shiba Inu dogs' vocal communications from YouTube videos and translate them into phonetic scripts using a systematic process. |
| Outcome: | The proposed framework produces the first-of-its-kind Shiba Inu vocal communication dataset . it will be useful for future research in zoology and linguistics. |
MorphAGram, Evaluation and Framework for Unsupervised Morphological Segmentation (2020.lrec-1)
Copied to clipboard
| Challenge: | Unsupervised morphological segmentation is beneficial for many natural language processing tasks. |
| Approach: | They propose a framework for unsupervised morphological segmentation that uses Adaptor Grammars. |
| Outcome: | The proposed framework achieves state-of-the-art results across languages of different typologies, from fusional to polysynthetic and from high-resource to low-resourced. |
CTAP for Italian: Integrating Components for the Analysis of Italian into a Multilingual Linguistic Complexity Analysis Tool (2020.lrec-1)
Copied to clipboard
| Challenge: | Linguistic complexity is a core construct in Second Language Acquisition (SLA) research. |
| Approach: | They present an open source linguistic complexity measurement tool for Italian . they compare it to existing tools for English and germany . |
| Outcome: | The proposed tool is the most comprehensive linguistic complexity measurement tool for italian . it can be used to compare italian texts to multiple other languages in one tool . |
Towards Explainable Chinese Native Learner Essay Fluency Assessment: Dataset, Tasks, and Method (2024.findings-emnlp)
Copied to clipboard
Xinshu Shen, Hongyi Wu, Yadong Zhang, Man Lan, Xiaopeng Bai, Shaoguang Mao, Yuanbin Wu, Xinlin Zhuang, Li Cai
| Challenge: | Existing GEC datasets in Chinese fail to consider specific grammatical error types and overlook cross-sentence grammamatical errors. |
| Approach: | They propose to use Chinese essay fluency assessment to assess essay fluencies along with coarse and fine-grained errors and corrections to improve explainability. |
| Outcome: | The proposed dataset encapsulates essay fluency scores along with both coarse and fine-grained errors and corrections. |
HeQ: a Large and Diverse Hebrew Reading Comprehension Benchmark (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Current benchmarks for Hebrew Natural Language Processing (NLP) focus mainly on morpho-syntactic tasks, neglecting the semantic dimension of language understanding. |
| Approach: | They propose to use Hebrew machine reading comprehension (MRC) as extractive Question Answering to address this problem. |
| Outcome: | The proposed benchmark features 30,147 question-answer pairs derived from both Hebrew Wikipedia articles and Israeli tech news. |
Improbable Bigrams Expose Vulnerabilities of Incomplete Tokens in Byte-Level Tokenizers (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have revealed that tokenizers can be exploited to elicit unwanted behavior. |
| Approach: | They propose to exploit incomplete tokens with stray bytes to exploit their dependency . they propose to use improbable bigrams to exploit the dependency of their adjacent tokens . |
| Outcome: | The proposed tokenizers can be exploited to elicit unwanted behavior in language models. |
SPENCE: A Syntactic Probe for Detecting Contamination in NL2SQL Benchmarks (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have achieved strong performance on natural language to SQL (NL2SQL) benchmarks, yet their reported accuracy may be inflated by contamination from benchmark queries or structurally similar patterns seen during training. |
| Approach: | They propose a syntactic probing framework for detecting and quantifying such contamination in large language models. |
| Outcome: | The proposed framework generates syntactic variants of test queries for four widely used NL2SQL datasets. |
LLMSegm: Surface-level Morphological Segmentation Using Large Language Model (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to morphological segmentation split word into its morphemes . LLMSegm is applicable in low-data settings and low-resourced languages . |
| Approach: | They propose a novel approach to surface-level morphological segmentation leveraging large language models. |
| Outcome: | The proposed method is applicable in low-data settings and low-resource languages. |
Measuring Cross-Text Cohesion for Segmentation Similarity Scoring (2024.lrec-main)
Copied to clipboard
| Challenge: | a new segmentation similarity metric is being developed for text segmentation . current metrics are content-agnostic and do not provide fine-grained scoring . |
| Approach: | They propose a word-embedding-based metric of cross-textual cohesion based on the formal linguistic definition of cohetion and incorporate it into a new segmentation similarity metric, SED. |
| Outcome: | The proposed metric provides fine-grained segmentation similarity scoring for 3 basic errors, avoiding limitations of traditional metrics. |
Using Shapley interactions to understand how models use structure (2025.acl-long)
Copied to clipboard
| Challenge: | Language models are intricately structured systems, and attribution measures are important for understanding how they combine features to influence outputs. |
| Approach: | They use Shapley Taylor interaction indices to examine how language and speech models internally relate and structure their inputs. |
| Outcome: | The proposed methods show that language models encode phonetic interactions . they show that the inputs are more entangled for pairs where a consonant influences a vowel or approximant . |
Motion Capture Analysis of Verb and Adjective Types in Austrian Sign Language (ÖGS) (2024.lrec-main)
Copied to clipboard
Julia Krebs, Evguenia A. Malaia, Isabella Fessl, Hans-Peter Wiesinger, Dietmar Roehm, Ronnie Wilbur, Hermann Schwameder
| Challenge: | Temporal and spatial characteristics of dominant hand articulation are used to express semantic and grammatical features across sign languages. |
| Approach: | They use motion capture data from four Deaf signers to characterize kinematic parameters of sign production in verbs and adjectives. |
| Outcome: | The results show that the endpoint marking in verbs and marking of intensification in adjectives are expressed by movement modulation in GS. |
KatFishNet: Detecting LLM-Generated Korean Text through Linguistic Feature Analysis (2025.acl-long)
Copied to clipboard
| Challenge: | Detecting LLM-generated text is crucial for academic integrity, preventing plagiarism, protecting copyrights, ethical research practices. |
| Approach: | They propose a method specifically designed for Korean language to detect LLM-generated text . they examine spacing patterns, part-of-speech diversity, and comma usage . |
| Outcome: | The proposed method achieves an average of 19.78% higher AUC-ROC compared to the best-performing detection method. |
Typology-Guided Adaptation in Multilingual Models (2025.acl-long)
Copied to clipboard
| Challenge: | Multilingual models often treat language diversity as a problem of data imbalance, overlooking structural variation. |
| Approach: | They propose a typologically grounded metric that quantifies how strongly a language relies on morphology for noun classification. |
| Outcome: | The proposed model outperforms baseline models on 10 Bantu languages . it improves Swahili accuracy by 14 points while maintaining performance on morphology-rich languages like Zulu . |
Semantic-pragmatic Annotations in the Prague Dependency Treebank (2026.findings-acl)
Copied to clipboard
Marie Mikulová, Eva Hajicova, Jiří Mírovský, Anna Nedoluzhko, Michal Novák, Pavlína Synková, Jan Štěpánek, Barbora Štěpánková, Jan Hajič
| Challenge: | morphology and syntax work on sentence level, but semantic-pragmatic phenomena are often related to two or more neighbouring sentences and possibly to an extra-linguistic context. |
| Approach: | They present semantic-pragmatic specification and annotations in the Prague Dependency Treebank - Consolidated 2.0 release2 by annotating the entire corpus. |
| Outcome: | The proposed annotations are based on the Prague Dependency Treebank -Consolidated 2.0 (PDT-C 2.0) the dataset contains more than 3 million tokens (of Czech) manually annotated from morphology to surface and deep syntax including several types of semantic-pragmatic annotations. |
New Proposal of Greenberg’s Universal 14 from Typometrics (2024.lrec-main)
Copied to clipboard
| Challenge: | In his Universal 14, Greenberg stated that the normal and dominant order in all world languages was to place the condition before the conclusion in conditional sentences. |
| Approach: | They propose to review Greenberg's Universal 14 and reformulate it quantitatively based on occurrences in real texts in 50 languages. |
| Outcome: | The proposed Universal 14 is based on occurrences in real texts in 50 languages and is fulfilled in 100% of the cases compared to 60% in the sample. |
Modal Dependency Parsing via Biaffine Attention with Self-Loop (2025.findings-acl)
Copied to clipboard
| Challenge: | A modal dependency structure is a web of connections between events and sources of information in a document that allows for tracing of who-said-what with what levels of certainty. |
| Approach: | They propose a modal dependency structure that integrates biaffine attention with a large language model to optimize against domain-specific challenges of modal dependence parsing. |
| Outcome: | The proposed approach outperforms the previous state-of-the-art on English and Chinese datasets by 2% and 4% respectively. |
PILA: A Historical-Linguistic Dataset of Proto-Italic and Latin (2024.lrec-main)
Copied to clipboard
| Challenge: | Historical linguists hypothesize systems of sound change to explain the evolution of language over time, but the evidence is limited. |
| Approach: | They propose a dataset that consists of roughly 3,000 pairs of forms from Proto-Italic and Latin. |
| Outcome: | The proposed dataset enables historical linguists to enhance other datasets by enhancing them with the existing datasets. |
Producing a Parallel Universal Dependencies Treebank of Ancient Hebrew and Ancient Greek via Cross-Lingual Projection (2024.lrec-main)
Copied to clipboard
| Challenge: | Using parallel treebanks, syntactic changes can be identified and evaluated in translations, redactions, and commentaries. |
| Approach: | They propose to construct a treebank of Ancient Greek containing portions of the Septuagint by word-aligning and projecting from the parallel Ancient Hebrew text. |
| Outcome: | The proposed treebank contains portions of the Hebrew Scriptures, which are translated into Ancient Greek, and is based on the results of a collaborative effort to create a crosslinguistically consistent treebank annotation scheme. |
Unsupervised Morphological Tree Tokenizer (2025.findings-acl)
Copied to clipboard
| Challenge: | Conventional statistical tokenizers often disrupt constituent boundaries within words, thereby corrupting semantic information. |
| Approach: | They propose a method that uses morphological structure guidance to induce character-level structures of words by training a deep model. |
| Outcome: | Empirical results show that the proposed method retains complete morphemes and outperforms existing methods on morphological segmentation and language modeling tasks. |
Refining rtMRI Landmark-Based Vocal Tract Contour Labels with FCN-Based Smoothing and Point-to-Curve Projection (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for labeling articulator contours are based on a ground truth label, but there are occasional errors. |
| Approach: | They propose to refine landmark-based vocal-tract contour labels using outlier removal, full convolutional network and a landmark point-to-edge curve projection technique. |
| Outcome: | The proposed labels outperform existing labels and their accuracy through subjective assessments of several contour areas. |
fLSA: Learning Semantic Structures in Document Collections Using Foundation Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) can be used to solve new tasks by inducing high-level strategies from example solutions to similar problems and adapting these strategies to solve unseen problems. |
| Approach: | They propose a foundation-model-based Latent Semantic Analysis method that iteratively clusters and tags document segments based on document-level contexts. |
| Outcome: | The proposed method is more informative in reconstructing the original texts than existing tagging methods. |
Creating Grammar Teaching Material for Endangered Languages with Hybrid Grammar Induction (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for creating grammar lessons are labor-intensive and often fall to teachers who lack formal training in grammar. |
| Approach: | They propose a hybrid grammar-induction method that uses typological priors, Bayesian inference, constrained LLM reasoning and retrieval from sparse corpora to generate topic-specific grammar lessons. |
| Outcome: | The proposed method can produce coherent and useful lessons with better quality when modest explanatory evidence is available. |
Active Learning for Multidialectal Arabic POS Tagging (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multidialectal Arabic POS tagging is challenging due to the morphological richness and high variability among dialects. |
| Approach: | They propose an active learning approach for multidialectal Arabic POS tagging . they annotate approximately 15,000 tokens, reducing the annotation requirement by about 2,000 tokens . |
| Outcome: | The proposed approach achieves 97.6% accuracy on the Emirati corpus. |
Modal Dependency Parsing as Structured Prediction over Source-Cue Scope (2026.acl-long)
Copied to clipboard
| Challenge: | Existing work on identifying sources only focuses on defining source-introducing cues . a structured model focuses learning at the source-cue level and constrains event-level decisions to a small, scope-defined candidate set. |
| Approach: | They propose a framework that leverages large language models to explicitly identify source-cue pairs and their respective scope to define modal contexts. |
| Outcome: | The proposed framework surpasses state-of-the-art results by 3 and 4% for English and Chinese datasets. |
DISC: Plug-and-Play Decoding Intervention with Similarity of Characters for Chinese Spelling Check (2025.acl-long)
Copied to clipboard
Ziheng Qiao, Houquan Zhou, Yumeng Liu, Zhenghua Li, Min Zhang, Bo Zhang, Chen Li, Ji Zhang, Fei Huang
| Challenge: | Chinese spelling check (CSC) tasks require that incorrect characters are usually similar to the correct ones in either phonetics or glyph. |
| Approach: | They propose a plug-and-play decoding intervention with similarity of characters module for Chinese spelling check (CSC) they propose to incorporate phonetic and glyph similarities only during the inference phase. |
| Outcome: | The proposed method significantly improves Chinese spelling check models on benchmarks and on benchmark datasets. |
Towards a Unified Taxonomy of Deep Syntactic Relations (2024.lrec-main)
Copied to clipboard
| Challenge: | Currently, UD is the standard for morphology and surface syntax annotations, but it is only one step towards natural language understanding. |
| Approach: | They propose to use a set of universal semantic role labels for morphology and surface syntax in four Indo-European and one Uralic languages to analyze the data. |
| Outcome: | The proposed set of universal semantic role labels is based on the data from four Indo-European and one Uralic languages. |
UCxn: Typologically-Informed Annotation of Constructions Atop Universal Dependencies (2024.lrec-main)
Copied to clipboard
Leonie Weissweiler, Nina Böbel, Kirian Guiller, Santiago Herrera, Wesley Samuel Scivetti, Arthur Lorenzi, Nurit Melnik, Archna Bhatia, Hinrich Schütze, Lori Levin, Amir Zeldes, Joakim Nivre, William Croft, Nathan Schneider
| Challenge: | Grammatical constructions that convey meaning through a particular combination of several morphosyntactic elements are not labeled holistically. |
| Approach: | They propose to augment UD annotations with a ‘UCxn’ annotation layer for such meaning-bearing grammatical constructions and to approach this in a typologically informed way so that morphosyntactic strategies can be compared across languages. |
| Outcome: | The proposed annotation layer could be used to annotate meaning-bearing constructions across languages and to compare them across languages. |
Using Speech Technology to Test Theories of Phonetic and Phonological Typology (2024.lrec-main)
Copied to clipboard
| Challenge: | acoustic studies show that obstruents in European Portuguese have different voicing profiles than their Romance relatives. |
| Approach: | They propose to use speech technology to test phonetic typology in European Portuguese . they use acoustic phone models to force align different phone models for obstruents . |
| Outcome: | The proposed method supports previous accounts that European Portuguese is diverging from the traditional voicing system known for Romance languages towards a hybrid system where stops and fricatives are specified for different voicing features. |
WkNER: Enhancing Named Entity Recognition with Word Segmentation Constraints and kNN Retrieval (2024.lrec-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) tasks require detecting the span and category of the entity from the text block. |
| Approach: | They propose a kNN retrieval enhancement algorithm that incorporates word segmentation information to enhance the model’s generalization ability and alleviate the problem of missing entity tokens in prediction. |
| Outcome: | The proposed method improves the performance of baseline models and achieves better or compared recognition accuracy than previous state-of-the-art models in multiple public Chinese and English datasets. |
Towards Language-Agnostic STIPA: Universal Phonetic Transcription to Support Language Documentation at Scale (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing ASR systems focus on orthographic output for high-resource languages, but STIPA can be used as a language-agnostic interface for documenting under-resourced and unwritten languages. |
| Approach: | They propose to use the International Phonetic Alphabet (STIPA) to generate phonetic transcriptions using a language-agnostic interface. |
| Outcome: | The proposed model reduces phonetic error rates even in low-resource settings and can be used for documenting under-resourced and unwritten languages. |
More Aligned, Less Diverse? Analyzing the Grammar and Lexicon of Two Generations of LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | a growing number of studies compare LLMs with human-authored text . diversity is unclear, but it is important to understand what makes human and machine writing distinct . |
| Approach: | They compare syntactic properties of AI-generated and human-authored English news texts . they use the Head-Driven Phrase Structure Grammar and the English Resource Grammar . |
| Outcome: | The proposed model differs from human-authored English news text in two years. |
Edit-Aware Reward Modeling for Chinese Grammatical Error Correction (2026.acl-long)
Copied to clipboard
| Challenge: | Recent work has applied reinforcement learning with rule-based rewards to grammatical error correction tasks, but these methods fail to capture fine-grained quality distinctions among correction candidates. |
| Approach: | They propose an Edit-Aware Reward Model that explicitly incorporates edit-awareness into preference learning for CGEC. |
| Outcome: | The proposed model outperforms rule-based models on CGEC and other NLP tasks by 5.41 and 1.80 points. |
MorphBPE: Morphology-Aware Tokenization for Efficient LLM Training (2026.findings-acl)
Copied to clipboard
| Challenge: | Tokenization is a key design choice in modern NLP systems and a critical bottleneck for multilingual Large Language Models. |
| Approach: | They propose a tokenization extension that constrains merge operations to respect morpheme boundaries while preserving inference. |
| Outcome: | The proposed tokenization improves morphological coherence and language model cross-entropy in four languages. |
Corpora Generation for Urdu Grammatical Error Correction (2026.findings-acl)
Copied to clipboard
| Challenge: | grammatical error correction (GEC) for Urdu remains under-researched due to lack of annotated datasets. |
| Approach: | They propose a method for synthesizing a large dataset by collecting errors from the Urdu WikiEdits history and learning from them. |
| Outcome: | The proposed method synthesizes a large dataset and fine-tunes models against it. |
Typology-Aware Multilingual Morphosyntactic Parsing with Joint Abstract Node Modeling (2026.acl-long)
Copied to clipboard
| Challenge: | UniDive 2025 Morphosyntactic Parsing (MSP) shared task unifies dependency structure, morphological features, and unrealized arguments. |
| Approach: | They propose a multilingual, typology-aware joint system that integrates word-type prediction, content-only parsing, morphological tagging, and an abstract-node component within a single architecture. |
| Outcome: | The proposed model outperforms the leading submission by 3.23 percentage points in MSLAS, 3.35 in LAS, and 1.78 in FEATS macro F1. |